Search Results - RepositoryStats

firecrawl mendableai

3.0k

34.1k

agpl-3.0

180

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

ai llm rag data crawler scraper markdown scraping ai-scraping web-crawler webscraping html-to-markdown

Created 2024-04-15

3,133 commits to main branch, last one 7 hours ago

Scrapling D4Vinci

186

2.8k

bsd-3-clause

25

🕷️ An undetectable, powerful, flexible, high-performance Python library that makes Web Scraping simple and easy again!

Created 2024-10-13

386 commits to main branch, last one 18 days ago

CyberScraper-2077 itsOwen

145

1.6k

mit

12

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

llm openai scraper gemini-api ai-scraping llm-scraper web-scraper webscraping

Created 2024-08-17

71 commits to main branch, last one 2 months ago

parsera raznem

63

1.1k

gpl-2.0

16

Lightweight library for scraping web-sites with LLMs

ai llm python scraping opensource playwright ai-scraping webscraping data-extraction

Created 2024-08-12

125 commits to main branch, last one 16 days ago

firecrawl-app-examples mendableai

56

212

unknown

2

🔥 This repository contains complete application examples, including websites and other projects, developed using Firecrawl.

ai llm rag data examples markdown scrapers templates ai-scraping web-crawler html-to-markdown

Created 2024-06-22

85 commits to main branch, last one a day ago

abx-dl ArchiveBox

4

68

mit

5

⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like youtube-dl/yt-dlp, forum-dl, gallery-dl, simpler ArchiveBox). 🎭 Uses headless Chrome to get HTML, JS, CSS, images/video/audio/s...

cli curl wget chrome yt-dlp cli-tool crawling headless scraping puppeteer archivebox downloader gallery-dl playwright youtube-dl ai-scraping http-client internet-archiving

Created 2024-10-21

92 commits to main branch, last one 3 months ago