Search Results - RepositoryStats

1.8k

11.4k

bsd-3-clause

213

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

go docker scrapy spider crawlab crawler platform webspider scrapyd-ui webcrawler web-crawler crawling-tasks spiders-management

Created 2019-02-10

2,674 commits to main branch, last one about a month ago

74

223

bsd-3-clause

12

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

scrapy spider crawlab crawler scrapyd platform scrapy-ui scrapyd-ui web-crawler crawling-tasks crawler-management

Created 2020-03-20

113 commits to master branch, last one 2 years ago

12

84

bsd-3-clause

5

An intelligent web service to automatically detect web content and extract information from it.

web spider crawlab crawler

Created 2023-01-13

247 commits to main branch, last one about a year ago