Search Results - RepositoryStats

1.8k

11.4k

bsd-3-clause

214

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

go docker scrapy spider crawlab crawler platform webspider scrapyd-ui webcrawler web-crawler crawling-tasks spiders-management

Created 2019-02-10

2,674 commits to main branch, last one 2 months ago

scrapydweb my8100

567

3.2k

gpl-3.0

73

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:

scrapy spider scrapyd dashboard scrapyd-ui log-parsing scrapyd-api log-analysis scrapyd-admin scrapyd-keeper scrapyd-manage scrapyd-control scrapyd-monitor scrapy-log-analysis scrapy-visualization scrapyd-log-analysis scrapyd-visualization scrapyd-cluster-management

Created 2018-09-30

70 commits to master branch, last one 2 months ago

SpiderKeeper DormyMo

508

2.7k

unknown

107

admin ui for scrapy/open source scrapinghub

scrapy spider scrapyd dashboard scrapy-ui scrapyd-ui scrapyd-dashboard

Created 2016-01-18

104 commits to master branch, last one 6 years ago

crawlab-lite crawlab-team

75

224

bsd-3-clause

12

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

scrapy spider crawlab crawler scrapyd platform scrapy-ui scrapyd-ui web-crawler crawling-tasks crawler-management

Created 2020-03-20

113 commits to master branch, last one 2 years ago

scrapeops-scrapy-sdk ScrapeOps

9

36

bsd-3-clause

3

Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the box.

scrapy spider scrapyd scraping monitoring scrapyd-ui scrapy-monitor monitoring-tool scrapy-log-analysis scrapy-visualization

Created 2021-08-17

53 commits to master branch, last one 5 months ago