Statistics for topic crawler

RepositoryStats tracks 584,797 Github repositories, of these 565 are tagged with the crawler topic. The most common primary language for repositories using this topic is Python (270). Other languages include: Go (69),  JavaScript (51),  Java (28),  PHP (27),  TypeScript (26),  C# (16),  HTML (16)

Stargazers over time for topic crawler

Most starred repositories for topic crawler (view more)

10.6k
53.2k
bsd-3-clause
1.8k
Scrapy, a fast high-level web crawling & scraping framework for Python.
Created 2010-02-22
10,621 commits to master branch, last one a day ago
4.4k
36.1k
other
226
A visual no-code/code-free web crawler/spider易采集:一个可视化浏览器自动化测试/数据采集/爬虫软件,可以无代码图形化的设计和执行爬虫任务。别名:ServiceWrapper面向Web应用的智能化服务封装系统。
Created 2020-07-18
586 commits to master branch, last one 14 hours ago
3.0k
27.8k
mit
381
👾 Fast and simple video download library and CLI tool written in Go
Created 2018-02-24
857 commits to master branch, last one about a month ago
1.8k
23.3k
apache-2.0
333
Elegant Scraper and Crawler Framework for Golang
Created 2017-09-29
666 commits to master branch, last one 5 months ago
5.2k
21.6k
mit
447
Python ProxyPool for web spider
Created 2016-11-25
652 commits to master branch, last one 2 months ago
1.4k
18.9k
agpl-3.0
102
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Created 2024-04-15
2,248 commits to main branch, last one 14 hours ago

Trending repositories for topic crawler (view more)