Statistics for topic web-scraper

RepositoryStats tracks 595,856 Github repositories, of these 62 are tagged with the web-scraper topic. The most common primary language for repositories using this topic is Python (27).

Stargazers over time for topic web-scraper

Most starred repositories for topic web-scraper (view more)

awesome-crawler BruceDone

708

6.5k

mit

201

A collection of awesome web crawler,spider in different languages

spider awesome crawler scraper web-crawler web-scraper node-crawler

Created 2016-10-10

108 commits to master branch, last one about a year ago

maxun getmaxun

445

6.1k

agpl-3.0

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

api rpa agents browser no-code scraper web-agent automation playwright self-hosted web-scraper webscraping web-scraping web-automation website-to-api data-extraction browser-automation web-scraping-agent no-code-web-scraper robotic-process-automation

Created 2023-10-23

3,715 commits to develop branch, last one a day ago

php-curl-class php-curl-class

819

3.3k

unlicense

164

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

api php xml curl http json class proxy client restful php-curl requests framework api-client http-proxy http-client web-scraper web-service web-scraping php-curl-library

Created 2013-08-16

1,986 commits to master branch, last one 3 days ago

100ProjectsOfCode arpit-omprakash

291

3.2k

mit

102

A list of practical knowledge-building projects.

c java cpp11 csharp python projects javascript processing programming web-scraper music-player search-engine

Created 2020-10-05

21 commits to main branch, last one 4 years ago

soup anaskhan96

169

2.2k

mit

Web Scraper in Go, similar to BeautifulSoup

go golang html-node webscraper web-scraper webscraping beautifulsoup

Created 2017-02-23

156 commits to master branch, last one 2 years ago

Scrapling D4Vinci

1.7k

bsd-3-clause

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

ai data xpath python crawler python3 stealth crawling scraping selectors automation playwright ai-scraping web-scraper webscraping web-scraping hacktoberfest crawling-python data-extraction web-scraping-python

Created 2024-10-13

299 commits to main branch, last one 2 days ago

Trending repositories for topic web-scraper (view more)

Last 3 days (new repositories)

no newly created repositories trending in the last 3 days

Last 3 days (absolute gain)

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

6,126 (+48)

agpl-3.0

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,730 (+36)

bsd-3-clause

spider-rs/spider

A web crawler and scraper for Rust

1,254 (+14)

mit

BruceDone/awesome-crawler

A collection of awesome web crawler,spider in different languages

6,539 (+10)

mit

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,478 (+6)

mit

Last 3 days (relative gain)

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,730 (+2%)

bsd-3-clause

spider-rs/spider

A web crawler and scraper for Rust

1,254 (+1%)

mit

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

6,126 (+0.8%)

agpl-3.0

paulpierre/markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

329 (+0.6%)

mit

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,478 (+0.4%)

mit

Last week (new repositories)

no newly created repositories trending in the last week

Last week (absolute gain)

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

6,126 (+135)

agpl-3.0

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,730 (+61)

bsd-3-clause

spider-rs/spider

A web crawler and scraper for Rust

1,254 (+26)

mit

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,478 (+16)

mit

BruceDone/awesome-crawler

A collection of awesome web crawler,spider in different languages

6,539 (+12)

mit

Last week (relative gain)

dinguschan-owo/Helios

Helios is an COMPLETELY UNBLOCKABLE proxy with tabs that can be static hosted, can be run locally, and html css js only! This is (as far as i've found) the only true UNBLOCKABLE only HTML proxy that w...

47 (+24%)

unlicense

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,730 (+4%)

bsd-3-clause

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

6,126 (+2%)

agpl-3.0

spider-rs/spider

A web crawler and scraper for Rust

1,254 (+2%)

mit

paulpierre/markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

329 (+2%)

mit

Last month (new repositories)

no newly created repositories trending in the last month

Last month (absolute gain)

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

6,126 (+1,225)

agpl-3.0

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,730 (+276)

bsd-3-clause

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,478 (+102)

mit

spider-rs/spider

A web crawler and scraper for Rust

1,254 (+98)

mit

gosom/google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

1,028 (+73)

mit

Last month (relative gain)

dinguschan-owo/Helios

47 (+135%)

unlicense

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

6,126 (+25%)

agpl-3.0

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,730 (+19%)

bsd-3-clause

spider-rs/spider

A web crawler and scraper for Rust

1,254 (+8%)

mit

gosom/google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

1,028 (+8%)

mit

Last 12-months (new repositories)

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,730

bsd-3-clause

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,478

mit

oxylabs/how-to-scrape-google-scholar

A guide for extracting titles, authors, and citations from Google Scholar using Python and Oxylabs SERP Scraper API.

347

dinguschan-owo/Helios

unlicense

Last 12-months (absolute gain)

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

6,126 (+6,125)

agpl-3.0

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,730 (+1,728)

bsd-3-clause

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,478 (+1,464)

mit

spider-rs/spider

A web crawler and scraper for Rust

1,254 (+864)

mit

gosom/google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

1,028 (+685)

mit

Last 12-months (relative gain)

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,478 (+10,457%)

mit

oxylabs/web-unblocker

Free trial Web Unblocker - an AI-powered proxy solution that can bypass even the most sophisticated anti-bot systems.

315 (+3,050%)

oxylabs/quick-start-guide

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

532 (+1,870%)

paulpierre/markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

329 (+498%)

mit

networkdynamics/pytok

A web scraper for TikTok using Playwright

61 (+336%)