Search Results - RepositoryStats

1.7k

10.9k

bsd-3-clause

211

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

go docker scrapy spider crawlab crawler platform webspider scrapyd-ui webcrawler web-crawler crawling-tasks spiders-management

Created 2019-02-10

2,558 commits to main branch, last one 7 months ago

71

218

bsd-3-clause

13

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

scrapy spider crawlab crawler scrapyd platform scrapy-ui scrapyd-ui web-crawler crawling-tasks crawler-management

Created 2020-03-20

113 commits to master branch, last one about a year ago

11

77

bsd-3-clause

5

An intelligent web service to automatically detect web content and extract information from it.

web spider crawlab crawler

Created 2023-01-13

247 commits to main branch, last one 10 months ago