Gerapy

Gerapy Public

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

Python 3,508MIT 645 0 7 Updated Jul 4, 2026

GerapyAutoExtractor Public

Auto Extractor Module

Python 338Apache-2.0 87 17 0 Updated Aug 19, 2024

GerapyRabbitMQ Public

Distribution Support for Scrapy & Gerapy using RabbitMQ

Python 9 1 2 0 Updated Nov 27, 2023

GerapyItemPipeline Public

Item Pipeline Components for Gerapy & Scrapy

Python 1 2 0 1 Updated Sep 20, 2023

GerapyPlaywright Public

Downloader Middleware to support Playwright in Scrapy & Gerapy

Python 111 21 13 1 Updated Mar 6, 2022

GerapyPyppeteer Public

Downloader Middleware to support Pyppeteer in Scrapy & Gerapy

Python 133 37 7 0 Updated Dec 27, 2021

GerapyPrometheusExporter Public

Gerapy Prometheus Exporter

Python 3 2 1 0 Updated Mar 16, 2021

GerapyRedis Public

Distribution Support for Scrapy & Gerapy using Redis

Python 8 1 0 0 Updated Mar 16, 2021

GerapySelenium Public

Downloader Middleware to support Selenium in Scrapy & Gerapy

Python 32 3 4 0 Updated Sep 13, 2020

Acinonyx Public

A package which can simplify your multiprocessing implementation

Python 4 0 0 0 Updated Jul 27, 2020

Navigation Menu

Uh oh!

Uh oh!

Gerapy

Pinned Loading

Repositories

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

People

Top languages

Uh oh!

Most used topics

Uh oh!