Pinned Loading

1. scrapydwebscrapydwebPublic

   Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. Docs 文档 👉

   Python 3.4k 583

2. logparserlogparserPublic

   A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.

   Python 94 22

3. scrapyd-cluster-on-herokuscrapyd-cluster-on-herokuPublic

   Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉

   Python 123 80

4. scrapydscrapydPublic

   Forked from scrapy/scrapyd

   [PR #326] Native support for basic auth 🔒 `pip install -U git+https://github.com/scrapy/scrapyd.git`, then add `username = yourusername` and `password = yourpassword` in the scrapyd.conf file. DOCS 👉

   Python 9 4

5. filesfilesPublic

   Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects

   418 69

6. notesnotesPublic

   Keep on reading

   Python 6 2