Search Results - RepositoryStats

1.7k

10.9k

bsd-3-clause

211

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

go docker scrapy spider crawlab crawler platform webspider scrapyd-ui webcrawler web-crawler crawling-tasks spiders-management

Created 2019-02-10

2,558 commits to main branch, last one 7 months ago

scrapydweb my8100

548

3.0k

gpl-3.0

75

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:

scrapy spider scrapyd dashboard scrapyd-ui log-parsing scrapyd-api log-analysis scrapyd-admin scrapyd-keeper scrapyd-manage scrapyd-control scrapyd-monitor scrapy-log-analysis scrapy-visualization scrapyd-log-analysis scrapyd-visualization scrapyd-cluster-management

Created 2018-09-30

69 commits to master branch, last one 3 months ago

SpiderKeeper DormyMo

503

2.7k

unknown

107

admin ui for scrapy/open source scrapinghub

scrapy spider scrapyd dashboard scrapy-ui scrapyd-ui scrapyd-dashboard

Created 2016-01-18

104 commits to master branch, last one 6 years ago

crawlab-lite crawlab-team

71

218

bsd-3-clause

13

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

scrapy spider crawlab crawler scrapyd platform scrapy-ui scrapyd-ui web-crawler crawling-tasks crawler-management

Created 2020-03-20

113 commits to master branch, last one about a year ago

scrapeops-scrapy-sdk ScrapeOps

7

36

bsd-3-clause

3

Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the box.

scrapy spider scrapyd scraping monitoring scrapyd-ui scrapy-monitor monitoring-tool scrapy-log-analysis scrapy-visualization

Created 2021-08-17

50 commits to master branch, last one 6 months ago