55 results found Sort:

302
5.7k
apache-2.0
102
Declarative web scraping
Created 2018-08-23
845 commits to master branch, last one 19 days ago
A Python module to bypass Cloudflare's anti-bot page.
Created 2013-02-28
156 commits to master branch, last one 4 years ago
116
982
apache-2.0
20
Crawly, a high-level web crawling & scraping framework for Elixir.
Created 2019-03-09
320 commits to master branch, last one about a month ago
Generate Free Edu Mail(s) within minutes
Created 2020-08-06
32 commits to master branch, last one 2 years ago
Build Bots, Scrape a website or use an API to solve a problem.
This repository has been archived (exclude archived)
Created 2020-09-10
1,720 commits to main branch, last one about a year ago
80
662
bsd-3-clause
24
Extract structured data from web sites. Web sites scraping.
Created 2017-02-09
885 commits to master branch, last one 4 years ago
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)
Created 2022-05-31
726 commits to master branch, last one 7 days ago
88
633
mit
24
OSINT tool - gets data from services like shodan, censys etc. in one app
Created 2020-01-21
529 commits to master branch, last one 2 years ago
🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.
Created 2018-12-21
207 commits to master branch, last one 7 months ago
Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.
Created 2022-03-14
10 commits to main branch, last one about a month ago
75
535
gpl-3.0
18
A universal web-util for PHP.
Created 2020-04-21
194 commits to master branch, last one 7 months ago
28
416
gpl-3.0
9
🧶 Extract data from any website without code, just clicks.
This repository has been archived (exclude archived)
Created 2020-11-20
74 commits to master branch, last one 3 years ago
81
369
wtfpl
14
A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)
Created 2020-05-22
57 commits to master branch, last one about a month ago
198
341
gpl-3.0
21
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup
Created 2020-07-10
66 commits to master branch, last one about a month ago
Library for Rapid (Web) Crawler and Scraper Development
Created 2022-01-12
394 commits to main branch, last one a day ago
32
305
agpl-3.0
9
An Aggregator Engine for searching and downloading movies free - NO ADs!
Created 2020-01-12
138 commits to master branch, last one about a year ago
Scrape all eBay sold listings to determine average/median pricing, plot listings over time with trend lines, and extract to excel
Created 2020-12-02
147 commits to master branch, last one 3 years ago
The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url
Created 2018-02-07
69 commits to master branch, last one about a year ago
Cloudflare Javascript & reCaptcha challenge (I'm Under Attack Mode or IUAM) solving / bypass .NET Standard library.
Created 2019-03-30
102 commits to master branch, last one 4 years ago
CLI and GUI for OSINT. Are you very exhibited on the Internet? Check it! Twitter, Tinder, Facebook, Google, Yandex, BOE. It uses facial recognition to provide more accurate results.
Created 2019-07-02
181 commits to master branch, last one 3 years ago
Download YouTube video description and video comments without using the YouTube API.
Created 2019-02-26
23 commits to master branch, last one 5 months ago
Scrape Algorithm Questions from leetcode and generate html and epub file
Created 2020-02-27
20 commits to master branch, last one 10 months ago
This repository provides usage examples for the Python module Newspaper3k.
Created 2020-10-11
73 commits to main branch, last one 10 months ago
Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!
Created 2020-02-11
14 commits to master branch, last one 3 years ago
Library with a set of tools for scraping information about Nintendo games and its prices across all regions (NA, EU and JP).
This repository has been archived (exclude archived)
Created 2018-05-19
183 commits to main branch, last one about a month ago
A console application to scrape a valid watching links for any movie or series with exact season and episode number, you can also download a whole season with one click.
Created 2021-12-08
27 commits to main branch, last one 2 years ago
11
125
apache-2.0
8
Scraply a simple dom scraper to fetch information from any html based website
Created 2019-05-29
49 commits to master branch, last one 2 years ago
📰 Build RSS 2.0 feeds from websites (and JSON APIs) automatically or with a few CSS selectors.
Created 2018-05-27
288 commits to master branch, last one 7 days ago
Structural analysis tools for complex web sites
Created 2022-08-15
1,077 commits to main branch, last one 2 months ago