56 results found Sort:

304
5.8k
apache-2.0
101
Declarative web scraping
Created 2018-08-23
846 commits to master branch, last one about a month ago
A Python module to bypass Cloudflare's anti-bot page.
Created 2013-02-28
156 commits to master branch, last one 4 years ago
115
996
apache-2.0
20
Crawly, a high-level web crawling & scraping framework for Elixir.
Created 2019-03-09
320 commits to master branch, last one 3 months ago
Generate Free Edu Mail(s) within minutes
Created 2020-08-06
32 commits to master branch, last one 2 years ago
Build Bots, Scrape a website or use an API to solve a problem.
This repository has been archived (exclude archived)
Created 2020-09-10
1,720 commits to main branch, last one about a year ago
80
668
bsd-3-clause
24
Extract structured data from web sites. Web sites scraping.
Created 2017-02-09
885 commits to master branch, last one 4 years ago
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)
Created 2022-05-31
750 commits to master branch, last one 10 days ago
86
639
mit
24
OSINT tool - gets data from services like shodan, censys etc. in one app
Created 2020-01-21
529 commits to master branch, last one 2 years ago
🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.
Created 2018-12-21
207 commits to master branch, last one 8 months ago
75
545
gpl-3.0
18
A universal web-util for PHP.
Created 2020-04-21
194 commits to master branch, last one 8 months ago
Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.
Created 2022-03-14
10 commits to main branch, last one 2 months ago
28
417
gpl-3.0
9
🧶 Extract data from any website without code, just clicks.
This repository has been archived (exclude archived)
Created 2020-11-20
74 commits to master branch, last one 3 years ago
82
374
wtfpl
14
A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)
Created 2020-05-22
57 commits to master branch, last one 3 months ago
203
347
gpl-3.0
21
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup
Created 2020-07-10
66 commits to master branch, last one 2 months ago
Library for Rapid (Web) Crawler and Scraper Development
Created 2022-01-12
402 commits to main branch, last one 3 days ago
31
308
agpl-3.0
9
An Aggregator Engine for searching and downloading movies free - NO ADs!
Created 2020-01-12
138 commits to master branch, last one about a year ago
Scrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel
Created 2020-12-02
147 commits to master branch, last one 3 years ago
The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
Created 2018-02-07
69 commits to master branch, last one 2 years ago
Cloudflare Javascript & reCaptcha challenge (I'm Under Attack Mode or IUAM) solving / bypass .NET Standard library.
Created 2019-03-30
102 commits to master branch, last one 4 years ago
CLI and GUI for OSINT. Are you very exhibited on the Internet? Check it! Twitter, Tinder, Facebook, Google, Yandex, BOE. It uses facial recognition to provide more accurate results.
Created 2019-07-02
181 commits to master branch, last one 3 years ago
Download YouTube video description and video comments without using the YouTube API.
Created 2019-02-26
23 commits to master branch, last one 7 months ago
Scrape Algorithm Questions from leetcode and generate html and epub file
Created 2020-02-27
20 commits to master branch, last one 12 months ago
This repository provides usage examples for the Python module Newspaper3k.
Created 2020-10-11
73 commits to main branch, last one 11 months ago
Library with a set of tools for scraping information about Nintendo games and its prices across all regions (NA, EU and JP).
This repository has been archived (exclude archived)
Created 2018-05-19
183 commits to main branch, last one 2 months ago
Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!
Created 2020-02-11
14 commits to master branch, last one 3 years ago
A console application to scrape a valid watching links for any movie or series with exact season and episode number, you can also download a whole season with one click.
Created 2021-12-08
27 commits to main branch, last one 2 years ago
11
125
apache-2.0
8
Scraply a simple dom scraper to fetch information from any html based website
Created 2019-05-29
49 commits to master branch, last one 2 years ago
📰 Build RSS 2.0 feeds from websites (and JSON APIs) automatically or with a few CSS selectors.
Created 2018-05-27
303 commits to master branch, last one 4 days ago
Structural analysis tools for complex web sites
Created 2022-08-15
1,077 commits to main branch, last one 4 months ago