Insutanto / scrapy-distributed

A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.

Date Created 2020-08-02 (4 years ago)
Commits 28 (last one about a year ago)
Stargazers 56 (0 this week)
Watchers 6 (0 this week)
Forks 11
License unknown
Ranking

RepositoryStats indexes 616,861 repositories, of these Insutanto/scrapy-distributed is ranked #446,805 (28th percentile) for total stargazers, and #303,559 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #86,243/124,816.

Insutanto/scrapy-distributed is also tagged with popular topics, for these it's ranked: python (#18,046/22961),  redis (#1,443/1758),  kafka (#684/860),  crawler (#490/580),  rabbitmq (#390/470),  scraping (#279/369),  spider (#296/341),  scrapy (#141/169)

Other Information

Insutanto/scrapy-distributed has Github issues enabled, there are 10 open issues and 3 closed issues.

There have been 3 releases, the latest one was published on 2023-04-23 (about a year ago) with the name 2023.04.23 Support Scrapy 2.6+.

Star History

Github stargazers over time

6060505040403030202010100020212021Jul '21Jul '2120222022Jul '22Jul '2220232023Jul '23Jul '2320242024Jul '24Jul '2420252025

Watcher History

Github watchers over time, collection started in '23

6666665.55.5555555May '23May '23Jun '23Jun '23Jul '23Jul '23Aug '23Aug '23Sep '23Sep '23Oct '23Oct '23Nov '23Nov '23Dec '23Dec '2320242024Feb '24Feb '24Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25

Recent Commit History

2 commits on the default branch (master) since jan '22

22221111110000May '23May '23Jun '23Jun '23Jul '23Jul '23Aug '23Aug '23Sep '23Sep '23Oct '23Oct '23Nov '23Nov '23Dec '23Dec '2320242024Feb '24Feb '24Mar '24Mar '24Apr '24Apr '24May '24May '24Jun '24Jun '24Jul '24Jul '24Aug '24Aug '24Sep '24Sep '24Oct '24Oct '24Nov '24Nov '24Dec '24Dec '2420252025Feb '25Feb '25

Yearly Commits

Commits to the default branch (master) per year

2525202015151010550020202020202120212022202220242024

Issue History

Total Issues
Open Issues
Closed Issues
141412121010886644220020212021Jul '21Jul '2120222022Jul '22Jul '2220232023Jul '23Jul '2320242024Jul '24Jul '2420252025

Languages

The only known language in this repository is Python

PythonPython

updated: 2025-02-06 @ 05:43pm, id: 284488864 / R_kgDOEPT0oA