42 results found Sort:

168
2.2k
mit
36
Web Scraper in Go, similar to BeautifulSoup
Created 2017-02-23
156 commits to master branch, last one 2 years ago
Self-hosted webscraper.
Created 2024-07-06
139 commits to master branch, last one a day ago
42
686
gpl-3.0
27
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON docu...
Created 2015-06-11
753 commits to master branch, last one 7 months ago
92
350
other
40
An R web crawler and scraper
Created 2016-11-08
201 commits to master branch, last one 4 years ago
Scalable Python web scraping scripts for +40 popular domains
Created 2023-05-22
405 commits to main branch, last one a day ago
An AI assistant tool that integrates coding, writing, and reading functions. For better alternatives see https://monica.im/desktop
Created 2023-03-30
146 commits to main branch, last one about a year ago
Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object
Created 2016-08-10
83 commits to master branch, last one 2 years ago
Lego AI Parser is an open-source application that uses OpenAI to parse visible text of HTML elements.
This repository has been archived (exclude archived)
Created 2022-12-07
72 commits to master branch, last one 5 months ago
DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like Web...
Created 2019-02-19
55 commits to master branch, last one 5 years ago
15
155
apache-2.0
17
SQL Based DSL Web Scraper/Screen Scraper
Created 2015-09-03
333 commits to master branch, last one 4 years ago
Spotify Scraper to extract all the information from spotify, download mp3 with cover of the song
Created 2020-04-28
46 commits to master branch, last one about a year ago
A Python command-line tool for scraping and downloading subtitles from AppleTV and iTunes movie pages.
Created 2020-11-02
275 commits to main branch, last one 4 months ago
Automated Python Script to retrieve vaccine slots availability and get notified when a slot is available.
Created 2021-05-13
13 commits to main branch, last one 3 years ago
An automated, programming-free web scraper for interactive sites
Created 2018-05-18
425 commits to master branch, last one 3 years ago
A command line tool for checking your website for GDPR compliance.
Created 2018-05-18
63 commits to dev branch, last one 6 months ago
This Python script will download chapters from novels availaible on wuxiaworld.com saves then into the .epub format
Created 2017-05-25
91 commits to master branch, last one 5 years ago
Python implementation of web scraping of TripAdvisor with Selenium in a new 2019 website
Created 2019-05-07
37 commits to master branch, last one 2 years ago
A webscraper for the Django Framework that compares the product prices for various UK supermarkets
This repository has been archived (exclude archived)
Created 2019-11-12
17 commits to master branch, last one about a year ago
:earth_americas: :hotel: Scrape Booking.com :hotel: :earth_americas:
Created 2018-06-17
126 commits to master branch, last one 3 years ago
This is an unofficial API for the website pcpartpicker.com.
Created 2018-11-02
86 commits to master branch, last one 2 months ago
GoScrapy: Harnessing Go's power for blazingly fast web scraping, inspired by Python's Scrapy framework.
Created 2023-07-27
299 commits to main branch, last one a day ago
A web scraper to scrape email's and phone numbers from Websites.
Created 2020-04-16
6 commits to master branch, last one 2 years ago
25
75
gpl-3.0
4
A lightweight API for Pornhub
Created 2023-06-11
345 commits to master branch, last one 5 days ago
Puppeteer configured to scrape the posts and threads of any channel on Slack.
This repository has been archived (exclude archived)
Created 2021-09-06
147 commits to master branch, last one about a month ago
Fast flashcard searcher study tool
Created 2021-12-27
76 commits to main branch, last one about a year ago
Finds Jobs on LinkedIn using web-scraping
Created 2021-03-08
37 commits to master branch, last one 3 years ago
Automatically scrape the web data of people profiles on Linkedin based on a specific search query
Created 2020-11-22
25 commits to main branch, last one 11 months ago
📚 This is an adapted version of Jina AI's Reader for local deployment using Docker. Convert any URL to an LLM-friendly input with a simple prefix http://127.0.0.1:3000/https://website-to-scrape.com/
Created 2024-09-28
300 commits to main branch, last one about a month ago
7
55
gpl-3.0
2
Osint tool to scraper websites
Created 2023-07-04
35 commits to master branch, last one about a year ago
wsvuls - website vulnerability scanner detect issues [ outdated server software and insecure HTTP headers.]
Created 2022-02-28
32 commits to main branch, last one 2 years ago