Statistics for topic web-scraper

RepositoryStats tracks 584,796 Github repositories, of these 60 are tagged with the web-scraper topic. The most common primary language for repositories using this topic is Python (26).

Stargazers over time for topic web-scraper

Most starred repositories for topic web-scraper (view more)

awesome-crawler BruceDone

710

6.5k

mit

201

A collection of awesome web crawler,spider in different languages

spider awesome crawler scraper web-crawler web-scraper node-crawler

Created 2016-10-10

108 commits to master branch, last one about a year ago

maxun getmaxun

345

4.9k

agpl-3.0

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

api rpa maxun browser no-code scraper low-code automation playwright self-hosted spreadsheet web-scraper web-scraping web-automation website-to-api browser-automation no-code-web-scraper website-to-database website-to-spreadsheet robotic-process-automation

Created 2023-10-23

3,207 commits to master branch, last one 13 days ago

php-curl-class php-curl-class

821

3.3k

unlicense

164

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

api php xml curl http json class proxy client restful php-curl requests framework api-client http-proxy http-client web-scraper web-service web-scraping php-curl-library

Created 2013-08-16

1,984 commits to master branch, last one 13 days ago

100ProjectsOfCode arpit-omprakash

288

3.2k

mit

101

A list of practical knowledge-building projects.

c java cpp11 csharp python projects javascript processing programming web-scraper music-player search-engine

Created 2020-10-05

21 commits to main branch, last one 4 years ago

soup anaskhan96

168

2.2k

mit

Web Scraper in Go, similar to BeautifulSoup

go golang html-node webscraper web-scraper webscraping beautifulsoup

Created 2017-02-23

156 commits to master branch, last one 2 years ago

lightnovel-crawler dipu-bd

293

1.5k

gpl-3.0

Generate and download e-books from online sources.

python termux discord telegram lightnovel console-app web-scraper kindle-books lightnovel-crawler

Created 2018-01-17

4,613 commits to master branch, last one 23 days ago

Trending repositories for topic web-scraper (view more)

Last 3 days (new repositories)

no newly created repositories trending in the last 3 days

Last 3 days (absolute gain)

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

4,901 (+255)

agpl-3.0

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,459 (+87)

bsd-3-clause

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,376 (+17)

mit

gosom/google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

952 (+10)

mit

spider-rs/spider

A web crawler and scraper for Rust

1,154 (+5)

mit

Last 3 days (relative gain)

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,459 (+6%)

bsd-3-clause

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

4,901 (+5%)

agpl-3.0

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,376 (+1%)

mit

gosom/google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

952 (+1%)

mit

SenZmaKi/Senpwai

A desktop app for tracking and batch downloading anime

197 (+0.5%)

gpl-3.0

Last week (new repositories)

no newly created repositories trending in the last week

Last week (absolute gain)

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,459 (+667)

bsd-3-clause

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

4,901 (+563)

agpl-3.0

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,376 (+31)

mit

spider-rs/spider

A web crawler and scraper for Rust

1,154 (+19)

mit

gosom/google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

952 (+16)

mit

Last week (relative gain)

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,459 (+84%)

bsd-3-clause

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

4,901 (+13%)

agpl-3.0

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,376 (+2%)

mit

gosom/google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

952 (+2%)

mit

spider-rs/spider

A web crawler and scraper for Rust

1,154 (+2%)

mit

Last month (new repositories)

no newly created repositories trending in the last month

Last month (absolute gain)

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

4,901 (+4,792)

agpl-3.0

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,459 (+1,407)

bsd-3-clause

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,376 (+150)

mit

spider-rs/spider

A web crawler and scraper for Rust

1,154 (+95)

mit

gosom/google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

952 (+65)

mit

Last month (relative gain)

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

4,901 (+4,396%)

agpl-3.0

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,459 (+2,706%)

bsd-3-clause

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,376 (+12%)

mit

oxylabs/playwright-web-scraping

A tutorial for web scraping using Playwright headless browser

105 (+11%)

spider-rs/spider

A web crawler and scraper for Rust

1,154 (+9%)

mit

Last 12-months (new repositories)

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,459

bsd-3-clause

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,376

mit

oxylabs/how-to-scrape-google-scholar

A guide for extracting titles, authors, and citations from Google Scholar using Python and Oxylabs SERP Scraper API.

345

milahu/aiohttp_chromium

aiohttp-like interface to chromium. based on selenium_driverless to bypass cloudflare

mit

Last 12-months (absolute gain)

getmaxun/maxun

🔥 Open-source no-code web data extraction platform. Turn websites to APIs and spreadsheets with no-code robots in minutes! [In Beta]

4,901 (+4,900)

agpl-3.0

D4Vinci/Scrapling

Undetectable, Lightning-Fast, and Adaptive Web Scraping for Python

1,459 (+1,457)

bsd-3-clause

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,376 (+1,362)

mit

gosom/google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

952 (+848)

mit

spider-rs/spider

A web crawler and scraper for Rust

1,154 (+817)

mit

Last 12-months (relative gain)

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

1,376 (+9,729%)

mit

oxylabs/web-unblocker

Free trial Web Unblocker - an AI-powered proxy solution that can bypass even the most sophisticated anti-bot systems.

321 (+3,913%)

oxylabs/quick-start-guide

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

535 (+2,448%)

paulpierre/markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

311 (+1,381%)

mit

gosom/google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

952 (+815%)

mit