Crawley is an asynchronous web crawling and web request Python library.
httpcrawlerasyncaiohttprequestsunittestrobots-txtasynciorobots-parserasync-generatorwebrequestspolitehttp-rplaywrightplaywright-python
-
Updated
Jan 27, 2026 - Python
Crawley is an asynchronous web crawling and web request Python library.
Python, not my best suit. However, it's special for me for its simplicity. I mainly use it to solve CPs. Nevertheless, there are some uncommon Math skills I hope you can learn from here.
To associate your repository with the webrequests topic, visit your repo's landing page and select "manage topics."