Statistics for topic scraping

RepositoryStats tracks 584,797 Github repositories, of these 345 are tagged with the scraping topic. The most common primary language for repositories using this topic is Python (183). Other languages include: TypeScript (33),  JavaScript (32),  Go (20),  HTML (12),  PHP (12)

Stargazers over time for topic scraping

Most starred repositories for topic scraping (view more)

10.6k
53.2k
bsd-3-clause
1.8k
Scrapy, a fast high-level web crawling & scraping framework for Python.
Created 2010-02-22
10,621 commits to master branch, last one a day ago
1.8k
23.3k
apache-2.0
333
Elegant Scraper and Crawler Framework for Golang
Created 2017-09-29
666 commits to master branch, last one 5 months ago
Auto_Jobs_Applier_AI_Agent by AIHawk is an AI Agent that automates the jobs application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in an automated and per...
Created 2024-08-04
252 commits to main branch, last one 5 days ago
1.4k
18.9k
agpl-3.0
102
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Created 2024-04-15
2,248 commits to main branch, last one 14 hours ago
Python scraper based on AI
Created 2024-01-27
2,326 commits to main branch, last one a day ago
670
15.7k
apache-2.0
103
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o...
Created 2016-08-26
4,692 commits to master branch, last one a day ago

Trending repositories for topic scraping (view more)