🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:
Response:
Calculated Shard: 59 (from laksa091)

2. Crawled Status Check

Query:
Response:

3. Robots.txt Check

Query:
Response:

4. Spam/Ban Check

Query:
Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄
INDEXABLE
CRAWLED
14 days ago
🤖
ROBOTS ALLOWED

Page Info Filters

FilterStatusConditionDetails
HTTP statusPASSdownload_http_code = 200HTTP 200
Age cutoffPASSdownload_stamp > now() - 6 MONTH0.5 months ago
History dropPASSisNull(history_drop_reason)No drop reason
Spam/banPASSfh_dont_index != 1 AND ml_spam_score = 0ml_spam_score=0
CanonicalPASSmeta_canonical IS NULL OR = '' OR = src_unparsedNot set

Page Details

PropertyValue
URLhttps://pypi.org/project/aiomultiprocess/
Last Crawled2026-03-23 09:54:48 (14 days ago)
First Indexed2018-04-17 02:09:03 (7 years ago)
HTTP Status Code200
Meta Titleaiomultiprocess · PyPI
Meta DescriptionAsyncIO version of the standard multiprocessing module
Meta Canonicalnull
Boilerpipe Text
Take a modern Python codebase to the next level of performance. On their own, AsyncIO and multiprocessing are useful, but limited: AsyncIO still can't exceed the speed of GIL, and multiprocessing only works on one task at a time. But together, they can fully realize their true potential. aiomultiprocess presents a simple interface, while running a full AsyncIO event loop on each child process, enabling levels of concurrency never before seen in a Python application. Each child process can execute multiple coroutines at once, limited only by the workload and number of cores available. Gathering tens of thousands of network requests in seconds is as easy as: async with Pool () as pool : results = await pool . map ( < coroutine function > , < items > ) Install aiomultiprocess requires Python 3.6 or newer. You can install it from PyPI: $ pip3 install aiomultiprocess Usage Most of aiomultiprocess mimics the standard multiprocessing module whenever possible, while accounting for places that benefit from async functionality. Running your asynchronous jobs on a pool of worker processes is easy: import asyncio from aiohttp import request from aiomultiprocess import Pool async def get ( url ): async with request ( "GET" , url ) as response : return await response . text ( "utf-8" ) async def main (): urls = [ "https://noswap.com" , ... ] async with Pool () as pool : async for result in pool . map ( get , urls ): ... # process result if __name__ == '__main__' : # Python 3.7 asyncio . run ( main ()) # Python 3.6 # loop = asyncio.get_event_loop() # loop.run_until_complete(main()) Take a look at the User Guide for more details and examples. For further context, watch the PyCon US 2018 talk about aiomultiprocess, "Thinking Outside the GIL" : Slides available at Speaker Deck . License aiomultiprocess is copyright Amethyst Reese , and licensed under the MIT license. I am providing code in this repository to you under an open source license. This is my personal repository; the license you receive to my code is from me and not from my employer. See the LICENSE file for details.
Markdown
[Skip to main content](https://pypi.org/project/aiomultiprocess/#content) Switch to mobile version Warning Some features may not work without JavaScript. Please try enabling it if you encounter problems. Join the official Python Developers Survey 2026 and have a chance to win a prize [Take the 2026 survey\!](https://surveys.jetbrains.com/s3/python-developers-survey-2026) [![PyPI](https://pypi.org/static/images/logo-small.8998e9d1.svg)](https://pypi.org/) - [Help](https://pypi.org/help/) - [Docs](https://docs.pypi.org/) - [Sponsors](https://pypi.org/sponsors/) - [Log in](https://pypi.org/account/login/?next=https%3A%2F%2Fpypi.org%2Fproject%2Faiomultiprocess%2F) - [Register](https://pypi.org/account/register/) Menu - [Help](https://pypi.org/help/) - [Docs](https://docs.pypi.org/) - [Sponsors](https://pypi.org/sponsors/) - [Log in](https://pypi.org/account/login/?next=https%3A%2F%2Fpypi.org%2Fproject%2Faiomultiprocess%2F) - [Register](https://pypi.org/account/register/) # aiomultiprocess 0.9.1 pip install aiomultiprocess Copy PIP instructions [Latest version](https://pypi.org/project/aiomultiprocess/) Released: Apr 23, 2024 AsyncIO version of the standard multiprocessing module ### Navigation - [Project description](https://pypi.org/project/aiomultiprocess/#description) - [Release history](https://pypi.org/project/aiomultiprocess/#history) - [Download files](https://pypi.org/project/aiomultiprocess/#files) ### Verified details *These details have been [verified by PyPI](https://docs.pypi.org/project_metadata/#verified-details)* ###### Maintainers [![Avatar for amyreese from gravatar.com](https://pypi-camo.freetls.fastly.net/bb5901d42ac8898473d3be4772f8033acc890e83/68747470733a2f2f7365637572652e67726176617461722e636f6d2f6176617461722f62323233633433346634356530393161346230636137366633336336336363393f73697a653d3530) amyreese](https://pypi.org/user/amyreese/) ### Unverified details *These details have **not** been verified by PyPI* ###### Project links - [Documentation](https://aiomultiprocess.omnilib.dev/en/latest/) - [Github](https://github.com/omnilib/aiomultiprocess) ###### Meta - **License:** MIT License - **Author:** [Amethyst Reese](mailto:amethyst@n7.gg) - **Requires:** Python \>=3.8 - **Provides-Extra:** `dev` , `docs` ###### Classifiers - **Development Status** - [4 - Beta](https://pypi.org/search/?c=Development+Status+%3A%3A+4+-+Beta) - **Framework** - [AsyncIO](https://pypi.org/search/?c=Framework+%3A%3A+AsyncIO) - **Intended Audience** - [Developers](https://pypi.org/search/?c=Intended+Audience+%3A%3A+Developers) - **License** - [OSI Approved :: MIT License](https://pypi.org/search/?c=License+%3A%3A+OSI+Approved+%3A%3A+MIT+License) - **Topic** - [Software Development :: Libraries](https://pypi.org/search/?c=Topic+%3A%3A+Software+Development+%3A%3A+Libraries) [Report project as malware](https://pypi.org/project/aiomultiprocess/submit-malware-report/) - [Project description](https://pypi.org/project/aiomultiprocess/#description) - [Project details](https://pypi.org/project/aiomultiprocess/#data) - [Release history](https://pypi.org/project/aiomultiprocess/#history) - [Download files](https://pypi.org/project/aiomultiprocess/#files) ## Project description # aiomultiprocess Take a modern Python codebase to the next level of performance. [![version](https://pypi-camo.freetls.fastly.net/79015629c3d22cef57d00b522807437c987b423c/68747470733a2f2f696d672e736869656c64732e696f2f707970692f762f61696f6d756c746970726f636573732e737667)](https://pypi.org/project/aiomultiprocess) [![documentation](https://pypi-camo.freetls.fastly.net/90862c4716514e2f84334a2f666c75a098888e14/68747470733a2f2f72656164746865646f63732e6f72672f70726f6a656374732f61696f73716c6974652f62616467652f3f76657273696f6e3d6c6174657374)](https://aiomultiprocess.omnilib.dev/) [![changelog](https://pypi-camo.freetls.fastly.net/0ba53dd8e8e5c9398cc51e14d878cebddd784a0c/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f6368616e67652d6c6f672d626c7565)](https://aiomultiprocess.omnilib.dev/en/latest/changelog.html) [![license](https://pypi-camo.freetls.fastly.net/6af1e2a7ec6bde2fa675ffa4e21de9c95b325ae9/68747470733a2f2f696d672e736869656c64732e696f2f707970692f6c2f61696f6d756c746970726f636573732e737667)](https://github.com/omnilib/aiomultiprocess/blob/master/LICENSE) [![build status](https://pypi-camo.freetls.fastly.net/a9a8fe542d6fd7453daa298b0471a4ea141dd0cf/68747470733a2f2f6769746875622e636f6d2f6f6d6e696c69622f61696f6d756c746970726f636573732f776f726b666c6f77732f4275696c642f62616467652e737667)](https://github.com/omnilib/aiomultiprocess/actions) [![code coverage](https://pypi-camo.freetls.fastly.net/14785e594346e6544f9a0650a0f6f44bfb189d20/68747470733a2f2f696d672e736869656c64732e696f2f636f6465636f762f632f67682f6f6d6e696c69622f61696f6d756c746970726f63657373)](https://codecov.io/gh/omnilib/aiomultiprocess) [![code style](https://pypi-camo.freetls.fastly.net/fbfdc7754183ecf079bc71ddeabaf88f6cbc5c00/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f636f64652532307374796c652d626c61636b2d3030303030302e737667)](https://github.com/ambv/black) On their own, AsyncIO and multiprocessing are useful, but limited: AsyncIO still can't exceed the speed of GIL, and multiprocessing only works on one task at a time. But together, they can fully realize their true potential. aiomultiprocess presents a simple interface, while running a full AsyncIO event loop on each child process, enabling levels of concurrency never before seen in a Python application. Each child process can execute multiple coroutines at once, limited only by the workload and number of cores available. Gathering tens of thousands of network requests in seconds is as easy as: ``` async with Pool() as pool: results = await pool.map(<coroutine function>, <items>) ``` ## Install aiomultiprocess requires Python 3.6 or newer. You can install it from PyPI: ``` $ pip3 install aiomultiprocess ``` ## Usage Most of aiomultiprocess mimics the standard multiprocessing module whenever possible, while accounting for places that benefit from async functionality. Running your asynchronous jobs on a pool of worker processes is easy: ``` import asyncio from aiohttp import request from aiomultiprocess import Pool async def get(url): async with request("GET", url) as response: return await response.text("utf-8") async def main(): urls = ["https://noswap.com", ...] async with Pool() as pool: async for result in pool.map(get, urls): ... # process result if __name__ == '__main__': # Python 3.7 asyncio.run(main()) # Python 3.6 # loop = asyncio.get_event_loop() # loop.run_until_complete(main()) ``` Take a look at the [User Guide](https://aiomultiprocess.omnilib.dev/en/latest/guide.html) for more details and examples. For further context, watch the PyCon US 2018 talk about aiomultiprocess, ["Thinking Outside the GIL"](https://www.youtube.com/watch?v=0kXaLh8Fz3k): > [![IMAGE ALT TEXT](https://pypi-camo.freetls.fastly.net/27c247adbcda800c6e5ee28f9fef9b1af56e75c0/687474703a2f2f696d672e796f75747562652e636f6d2f76692f306b58614c6838467a336b2f302e6a7067)](http://www.youtube.com/watch?v=0kXaLh8Fz3k "PyCon 2018 - Amethyst Reese - Thinking Outside the GIL with AsyncIO and Multiprocessing") Slides available at [Speaker Deck](https://speakerdeck.com/jreese/thinking-outside-the-gil-2). ## License aiomultiprocess is copyright [Amethyst Reese](https://noswap.com/), and licensed under the MIT license. I am providing code in this repository to you under an open source license. This is my personal repository; the license you receive to my code is from me and not from my employer. See the `LICENSE` file for details. ## Project details ### Verified details *These details have been [verified by PyPI](https://docs.pypi.org/project_metadata/#verified-details)* ###### Maintainers [![Avatar for amyreese from gravatar.com](https://pypi-camo.freetls.fastly.net/bb5901d42ac8898473d3be4772f8033acc890e83/68747470733a2f2f7365637572652e67726176617461722e636f6d2f6176617461722f62323233633433346634356530393161346230636137366633336336336363393f73697a653d3530) amyreese](https://pypi.org/user/amyreese/) ### Unverified details *These details have **not** been verified by PyPI* ###### Project links - [Documentation](https://aiomultiprocess.omnilib.dev/en/latest/) - [Github](https://github.com/omnilib/aiomultiprocess) ###### Meta - **License:** MIT License - **Author:** [Amethyst Reese](mailto:amethyst@n7.gg) - **Requires:** Python \>=3.8 - **Provides-Extra:** `dev` , `docs` ###### Classifiers - **Development Status** - [4 - Beta](https://pypi.org/search/?c=Development+Status+%3A%3A+4+-+Beta) - **Framework** - [AsyncIO](https://pypi.org/search/?c=Framework+%3A%3A+AsyncIO) - **Intended Audience** - [Developers](https://pypi.org/search/?c=Intended+Audience+%3A%3A+Developers) - **License** - [OSI Approved :: MIT License](https://pypi.org/search/?c=License+%3A%3A+OSI+Approved+%3A%3A+MIT+License) - **Topic** - [Software Development :: Libraries](https://pypi.org/search/?c=Topic+%3A%3A+Software+Development+%3A%3A+Libraries) ## Release history [Release notifications](https://pypi.org/help/#project-release-notifications) \| [RSS feed](https://pypi.org/rss/project/aiomultiprocess/releases.xml) This version ![](https://pypi.org/static/images/blue-cube.572a5bfb.svg) [0\.9.1 Apr 23, 2024](https://pypi.org/project/aiomultiprocess/0.9.1/) ![](https://pypi.org/static/images/white-cube.2351a86c.svg) [0\.9.0 Mar 1, 2021](https://pypi.org/project/aiomultiprocess/0.9.0/) ![](https://pypi.org/static/images/white-cube.2351a86c.svg) [0\.8.0 Jul 27, 2020](https://pypi.org/project/aiomultiprocess/0.8.0/) ![](https://pypi.org/static/images/white-cube.2351a86c.svg) [0\.7.0 Nov 21, 2019](https://pypi.org/project/aiomultiprocess/0.7.0/) ![](https://pypi.org/static/images/white-cube.2351a86c.svg) [0\.6.1 Aug 20, 2019](https://pypi.org/project/aiomultiprocess/0.6.1/) ![](https://pypi.org/static/images/white-cube.2351a86c.svg) [0\.6.0 Jul 25, 2019](https://pypi.org/project/aiomultiprocess/0.6.0/) ![](https://pypi.org/static/images/white-cube.2351a86c.svg) [0\.5.0 Dec 28, 2018](https://pypi.org/project/aiomultiprocess/0.5.0/) ![](https://pypi.org/static/images/white-cube.2351a86c.svg) [0\.4.0 May 15, 2018](https://pypi.org/project/aiomultiprocess/0.4.0/) ![](https://pypi.org/static/images/white-cube.2351a86c.svg) [0\.3.0 Apr 10, 2018](https://pypi.org/project/aiomultiprocess/0.3.0/) ![](https://pypi.org/static/images/white-cube.2351a86c.svg) [0\.2.0 Apr 9, 2018](https://pypi.org/project/aiomultiprocess/0.2.0/) ![](https://pypi.org/static/images/white-cube.2351a86c.svg) [0\.1.0 Apr 8, 2018](https://pypi.org/project/aiomultiprocess/0.1.0/) ## Download files Download the file for your platform. If you're not sure which to choose, learn more about [installing packages](https://packaging.python.org/tutorials/installing-packages/ "External link"). ### Source Distribution [aiomultiprocess-0.9.1.tar.gz](https://files.pythonhosted.org/packages/02/d4/1e69e17dda5df91734b70d03dbbf9f222ddb438e1f3bf4ea8fa135ce46de/aiomultiprocess-0.9.1.tar.gz) (24.5 kB [view details](https://pypi.org/project/aiomultiprocess/#aiomultiprocess-0.9.1.tar.gz)) Uploaded Apr 23, 2024 `Source` ### Built Distribution Filter files by name, interpreter, ABI, and platform. If you're not sure about the file name format, learn more about [wheel file names](https://packaging.python.org/en/latest/specifications/binary-distribution-format/ "External link"). The dropdown lists show the available interpreters, ABIs, and platforms. Enable javascript to be able to filter the list of wheel files. Copy a direct link to the current filters <https://pypi.org/project/aiomultiprocess/#files> Copy Showing 1 of 1 file. File name Interpreter ABI Platform [aiomultiprocess-0.9.1-py3-none-any.whl](https://files.pythonhosted.org/packages/ad/14/c48c2f5c96960f5649a72b96a0a31d45384b37d89a63f7ccea76bf4fceba/aiomultiprocess-0.9.1-py3-none-any.whl) (17.5 kB [view details](https://pypi.org/project/aiomultiprocess/#aiomultiprocess-0.9.1-py3-none-any.whl)) Uploaded Apr 23, 2024 `Python 3` ## File details Details for the file `aiomultiprocess-0.9.1.tar.gz`. ### File metadata - Download URL: [aiomultiprocess-0.9.1.tar.gz](https://files.pythonhosted.org/packages/02/d4/1e69e17dda5df91734b70d03dbbf9f222ddb438e1f3bf4ea8fa135ce46de/aiomultiprocess-0.9.1.tar.gz) - Upload date: Apr 23, 2024 - Size: 24.5 kB - Tags: Source - Uploaded using Trusted Publishing? No - Uploaded via: python-requests/2.31.0 ### File hashes | Algorithm | Hash digest | | |---|---|---| | SHA256 | `f0231dbe0291e15325d7896ebeae0002d95a4f2675426ca05eb35f24c60e495b` | Copy | | MD5 | `c89390ad3fb01b2a8de5dbff6fc10fff` | Copy | | BLAKE2b-256 | `02d41e69e17dda5df91734b70d03dbbf9f222ddb438e1f3bf4ea8fa135ce46de` | Copy | [See more details on using hashes here.](https://pip.pypa.io/en/stable/topics/secure-installs/#hash-checking-mode "External link") ## File details Details for the file `aiomultiprocess-0.9.1-py3-none-any.whl`. ### File metadata - Download URL: [aiomultiprocess-0.9.1-py3-none-any.whl](https://files.pythonhosted.org/packages/ad/14/c48c2f5c96960f5649a72b96a0a31d45384b37d89a63f7ccea76bf4fceba/aiomultiprocess-0.9.1-py3-none-any.whl) - Upload date: Apr 23, 2024 - Size: 17.5 kB - Tags: Python 3 - Uploaded using Trusted Publishing? No - Uploaded via: python-requests/2.31.0 ### File hashes | Algorithm | Hash digest | | |---|---|---| | SHA256 | `3a7b3bb3c38dbfb4d9d1194ece5934b6d32cf0280e8edbe64a7d215bba1322c6` | Copy | | MD5 | `231cc5ec4a5e0f98138fff9bf5431b52` | Copy | | BLAKE2b-256 | `ad14c48c2f5c96960f5649a72b96a0a31d45384b37d89a63f7ccea76bf4fceba` | Copy | [See more details on using hashes here.](https://pip.pypa.io/en/stable/topics/secure-installs/#hash-checking-mode "External link") ![](https://pypi.org/static/images/white-cube.2351a86c.svg) ## Help - [Installing packages](https://packaging.python.org/tutorials/installing-packages/ "External link") - [Uploading packages](https://packaging.python.org/tutorials/packaging-projects/ "External link") - [User guide](https://packaging.python.org/ "External link") - [Project name retention](https://www.python.org/dev/peps/pep-0541/ "External link") - [FAQs](https://pypi.org/help/) ## About PyPI - [PyPI Blog](https://blog.pypi.org/ "External link") - [Infrastructure dashboard](https://dtdg.co/pypi "External link") - [Statistics](https://pypi.org/stats/) - [Logos & trademarks](https://pypi.org/trademarks/) - [Our sponsors](https://pypi.org/sponsors/) ## Contributing to PyPI - [Bugs and feedback](https://pypi.org/help/#feedback) - [Contribute on GitHub](https://github.com/pypi/warehouse "External link") - [Translate PyPI](https://hosted.weblate.org/projects/pypa/warehouse/ "External link") - [Sponsor PyPI](https://pypi.org/sponsors/) - [Development credits](https://github.com/pypi/warehouse/graphs/contributors "External link") ## Using PyPI - [Terms of Service](https://policies.python.org/pypi.org/Terms-of-Service/ "External link") - [Report security issue](https://pypi.org/security/) - [Code of conduct](https://policies.python.org/python.org/code-of-conduct/ "External link") - [Privacy Notice](https://policies.python.org/pypi.org/Privacy-Notice/ "External link") - [Acceptable Use Policy](https://policies.python.org/pypi.org/Acceptable-Use-Policy/ "External link") *** Status: [all systems operational](https://status.python.org/ "External link") Developed and maintained by the Python community, for the Python community. [Donate today\!](https://donate.pypi.org/) "PyPI", "Python Package Index", and the blocks logos are registered [trademarks](https://pypi.org/trademarks/) of the [Python Software Foundation](https://www.python.org/psf-landing). © 2026 [Python Software Foundation](https://www.python.org/psf-landing/ "External link") [Site map](https://pypi.org/sitemap/) Switch to desktop version Supported by [![](https://pypi-camo.freetls.fastly.net/ed7074cadad1a06f56bc520ad9bd3e00d0704c5b/68747470733a2f2f73746f726167652e676f6f676c65617069732e636f6d2f707970692d6173736574732f73706f6e736f726c6f676f732f6177732d77686974652d6c6f676f2d7443615473387a432e706e67) AWS Cloud computing and Security Sponsor](https://aws.amazon.com/) [![](https://pypi-camo.freetls.fastly.net/8855f7c063a3bdb5b0ce8d91bfc50cf851cc5c51/68747470733a2f2f73746f726167652e676f6f676c65617069732e636f6d2f707970692d6173736574732f73706f6e736f726c6f676f732f64617461646f672d77686974652d6c6f676f2d6668644c4e666c6f2e706e67) Datadog Monitoring](https://www.datadoghq.com/) [![](https://pypi-camo.freetls.fastly.net/60f709d24f3e4d469f9adc77c65e2f5291a3d165/68747470733a2f2f73746f726167652e676f6f676c65617069732e636f6d2f707970692d6173736574732f73706f6e736f726c6f676f732f6465706f742d77686974652d6c6f676f2d7038506f476831302e706e67) Depot Continuous Integration](https://depot.dev/) [![](https://pypi-camo.freetls.fastly.net/df6fe8829cbff2d7f668d98571df1fd011f36192/68747470733a2f2f73746f726167652e676f6f676c65617069732e636f6d2f707970692d6173736574732f73706f6e736f726c6f676f732f666173746c792d77686974652d6c6f676f2d65684d3077735f6f2e706e67) Fastly CDN](https://www.fastly.com/) [![](https://pypi-camo.freetls.fastly.net/420cc8cf360bac879e24c923b2f50ba7d1314fb0/68747470733a2f2f73746f726167652e676f6f676c65617069732e636f6d2f707970692d6173736574732f73706f6e736f726c6f676f732f676f6f676c652d77686974652d6c6f676f2d616734424e3774332e706e67) Google Download Analytics](https://careers.google.com/) [![](https://pypi-camo.freetls.fastly.net/d01053c02f3a626b73ffcb06b96367fdbbf9e230/68747470733a2f2f73746f726167652e676f6f676c65617069732e636f6d2f707970692d6173736574732f73706f6e736f726c6f676f732f70696e67646f6d2d77686974652d6c6f676f2d67355831547546362e706e67) Pingdom Monitoring](https://www.pingdom.com/) [![](https://pypi-camo.freetls.fastly.net/67af7117035e2345bacb5a82e9aa8b5b3e70701d/68747470733a2f2f73746f726167652e676f6f676c65617069732e636f6d2f707970692d6173736574732f73706f6e736f726c6f676f732f73656e7472792d77686974652d6c6f676f2d4a2d6b64742d706e2e706e67) Sentry Error logging](https://sentry.io/for/python/?utm_source=pypi&utm_medium=paid-community&utm_campaign=python-na-evergreen&utm_content=static-ad-pypi-sponsor-learnmore) [![](https://pypi-camo.freetls.fastly.net/b611884ff90435a0575dbab7d9b0d3e60f136466/68747470733a2f2f73746f726167652e676f6f676c65617069732e636f6d2f707970692d6173736574732f73706f6e736f726c6f676f732f737461747573706167652d77686974652d6c6f676f2d5467476c6a4a2d502e706e67) StatusPage Status page](https://statuspage.io/)
Readable Markdown
Take a modern Python codebase to the next level of performance. [![version](https://pypi-camo.freetls.fastly.net/79015629c3d22cef57d00b522807437c987b423c/68747470733a2f2f696d672e736869656c64732e696f2f707970692f762f61696f6d756c746970726f636573732e737667)](https://pypi.org/project/aiomultiprocess) [![documentation](https://pypi-camo.freetls.fastly.net/90862c4716514e2f84334a2f666c75a098888e14/68747470733a2f2f72656164746865646f63732e6f72672f70726f6a656374732f61696f73716c6974652f62616467652f3f76657273696f6e3d6c6174657374)](https://aiomultiprocess.omnilib.dev/) [![changelog](https://pypi-camo.freetls.fastly.net/0ba53dd8e8e5c9398cc51e14d878cebddd784a0c/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f6368616e67652d6c6f672d626c7565)](https://aiomultiprocess.omnilib.dev/en/latest/changelog.html) [![license](https://pypi-camo.freetls.fastly.net/6af1e2a7ec6bde2fa675ffa4e21de9c95b325ae9/68747470733a2f2f696d672e736869656c64732e696f2f707970692f6c2f61696f6d756c746970726f636573732e737667)](https://github.com/omnilib/aiomultiprocess/blob/master/LICENSE) [![build status](https://pypi-camo.freetls.fastly.net/a9a8fe542d6fd7453daa298b0471a4ea141dd0cf/68747470733a2f2f6769746875622e636f6d2f6f6d6e696c69622f61696f6d756c746970726f636573732f776f726b666c6f77732f4275696c642f62616467652e737667)](https://github.com/omnilib/aiomultiprocess/actions) [![code coverage](https://pypi-camo.freetls.fastly.net/14785e594346e6544f9a0650a0f6f44bfb189d20/68747470733a2f2f696d672e736869656c64732e696f2f636f6465636f762f632f67682f6f6d6e696c69622f61696f6d756c746970726f63657373)](https://codecov.io/gh/omnilib/aiomultiprocess) [![code style](https://pypi-camo.freetls.fastly.net/fbfdc7754183ecf079bc71ddeabaf88f6cbc5c00/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f636f64652532307374796c652d626c61636b2d3030303030302e737667)](https://github.com/ambv/black) On their own, AsyncIO and multiprocessing are useful, but limited: AsyncIO still can't exceed the speed of GIL, and multiprocessing only works on one task at a time. But together, they can fully realize their true potential. aiomultiprocess presents a simple interface, while running a full AsyncIO event loop on each child process, enabling levels of concurrency never before seen in a Python application. Each child process can execute multiple coroutines at once, limited only by the workload and number of cores available. Gathering tens of thousands of network requests in seconds is as easy as: ``` async with Pool() as pool: results = await pool.map(<coroutine function>, <items>) ``` ## Install aiomultiprocess requires Python 3.6 or newer. You can install it from PyPI: ``` $ pip3 install aiomultiprocess ``` ## Usage Most of aiomultiprocess mimics the standard multiprocessing module whenever possible, while accounting for places that benefit from async functionality. Running your asynchronous jobs on a pool of worker processes is easy: ``` import asyncio from aiohttp import request from aiomultiprocess import Pool async def get(url): async with request("GET", url) as response: return await response.text("utf-8") async def main(): urls = ["https://noswap.com", ...] async with Pool() as pool: async for result in pool.map(get, urls): ... # process result if __name__ == '__main__': # Python 3.7 asyncio.run(main()) # Python 3.6 # loop = asyncio.get_event_loop() # loop.run_until_complete(main()) ``` Take a look at the [User Guide](https://aiomultiprocess.omnilib.dev/en/latest/guide.html) for more details and examples. For further context, watch the PyCon US 2018 talk about aiomultiprocess, ["Thinking Outside the GIL"](https://www.youtube.com/watch?v=0kXaLh8Fz3k): > [![IMAGE ALT TEXT](https://pypi-camo.freetls.fastly.net/27c247adbcda800c6e5ee28f9fef9b1af56e75c0/687474703a2f2f696d672e796f75747562652e636f6d2f76692f306b58614c6838467a336b2f302e6a7067)](http://www.youtube.com/watch?v=0kXaLh8Fz3k "PyCon 2018 - Amethyst Reese - Thinking Outside the GIL with AsyncIO and Multiprocessing") Slides available at [Speaker Deck](https://speakerdeck.com/jreese/thinking-outside-the-gil-2). ## License aiomultiprocess is copyright [Amethyst Reese](https://noswap.com/), and licensed under the MIT license. I am providing code in this repository to you under an open source license. This is my personal repository; the license you receive to my code is from me and not from my employer. See the `LICENSE` file for details.
Shard59 (laksa)
Root Hash7813724874982801459
Unparsed URLorg,pypi!/project/aiomultiprocess/ s443