51 results found Sort:

2.7k
15.9k
mit
330
An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
This repository has been archived (exclude archived)
Created 2017-06-10
845 commits to master branch, last one 3 years ago
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Created 2020-08-31
142 commits to master branch, last one 2 months ago
A Python module to bypass Cloudflare's anti-bot page.
Created 2013-02-28
156 commits to master branch, last one 4 years ago
Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.
Created 2016-05-25
1,884 commits to master branch, last one 13 days ago
201
1.7k
mit
24
Twitter API Scraper | Without an API key | Twitter Internal API | Free | Twitter scraper | Twitter Bot
Created 2024-01-20
3 commits to main branch, last one 2 days ago
Implementation of X/Twitter v1, v2, and GraphQL APIs
Created 2023-03-11
230 commits to main branch, last one 8 months ago
226
1.1k
mit
17
A simple and unlimited twitter scraper : scrape tweets, likes, retweets, following, followers, user info, images...
Created 2020-12-14
217 commits to master branch, last one 4 months ago
82
626
mit
9
Scrape domain names from SSL certificates of arbitrary hosts
Created 2020-04-26
40 commits to master branch, last one about a year ago
Advanced python library to scrap Twitter (tweets, users) from unofficial API
Created 2020-11-16
274 commits to master branch, last one about a year ago
`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.
Created 2018-02-22
200 commits to master branch, last one 2 years ago
Scrape Instagram's API with Puppeteer
Created 2018-12-02
641 commits to master branch, last one 3 years ago
82
374
wtfpl
14
A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)
Created 2020-05-22
57 commits to master branch, last one 3 months ago
Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functiona...
Created 2021-04-16
799 commits to master branch, last one 8 days ago
23
293
unknown
7
Crawl telegra.ph searching for nudes!
Created 2023-02-01
96 commits to master branch, last one 5 months ago
A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library
Created 2017-02-20
73 commits to master branch, last one 3 years ago
Python library for retrieving free proxies (HTTP, HTTPS, SOCKS4, SOCKS5).
Created 2018-07-30
127 commits to master branch, last one 5 years ago
Node.js package to bypass CloudFlare's anti-bot JavaScript challenges
Created 2018-10-20
31 commits to master branch, last one about a year ago
This project provides a powerful web scraping tool that fetches search results and converts them into Markdown format using FastAPI, SearXNG, and Browserless. It includes the capability to use proxies...
Created 2024-06-05
30 commits to main branch, last one 4 months ago
scrape google search results
Created 2020-03-11
72 commits to master branch, last one about a year ago
🏴‍☠️💰 Another Ransomware gang tracker
Created 2023-05-29
435 commits to main branch, last one 17 days ago
1
154
mit
2
A simple (and unofficial) GitHub Trending client that lives in your menubar.
Created 2022-07-27
194 commits to master branch, last one 2 years ago
17
145
gpl-3.0
7
API to get enormous amount of high resolution satellite images from satellites.pro quickly through multi-threading! create map your own map dataset. Bringing data to Humans.
This repository has been archived (exclude archived)
Created 2019-02-05
291 commits to master branch, last one 5 months ago
25
135
other
10
Convert Files / Folders / GitHub Repos Into AI / LLM-ready Files
Created 2024-06-25
28 commits to main branch, last one about a month ago
A instagram scraper wrote in python. Similar to instagram-php-scraper.Usages are in example.py. Enjoy it!
Created 2019-06-02
31 commits to master branch, last one 5 years ago
📰 Build RSS 2.0 feeds from websites (and JSON APIs) automatically or with a few CSS selectors.
Created 2018-05-27
303 commits to master branch, last one 3 days ago
A lightning fast package to scrape YouTube search results
Created 2018-09-25
134 commits to master branch, last one 6 months ago
6
110
mit
4
A library use jQuery like API for html parsing & node selecting & node mutation, suitable for web scraping and html confusion.
Created 2021-01-08
203 commits to main branch, last one about a month ago
Golang pkg to quickly return a preview of a webpage (title/description/images)
Created 2017-01-26
14 commits to master branch, last one 5 years ago
n8n node for browser automation using Puppeteer
Created 2022-05-07
88 commits to main branch, last one a day ago
44
90
other
17
:spider: The PHP SERP Spider - A search engine scraper
Created 2016-02-03
203 commits to master branch, last one 4 years ago