1 result found Sort:

Insutanto
scrapy-distributed Insutanto
11
55
unknown
6
A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.
kafka redis python scrapy spider crawler crawling rabbitmq scraping redisbloom rabbitmq-pipeline distributed-spider
Created 2020-08-02
28 commits to master branch, last one about a year ago