4 results found Sort:

mendableai
firecrawl mendableai
1.4k
18.9k
agpl-3.0
102
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
ai llm rag data crawler scraper markdown scraping ai-scraping web-crawler webscraping html-to-markdown
Created 2024-04-15
2,248 commits to main branch, last one 16 hours ago
itsOwen
CyberScraper-2077 itsOwen
122
1.4k
mit
11
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
llm openai scraper gemini-api ai-scraping llm-scraper web-scraper webscraping
Created 2024-08-17
70 commits to main branch, last one 12 days ago
spider-rs
spider spider-rs
100
1.2k
mit
13
A web crawler and scraper for Rust
rust spider crawler indexer ai-scraping llm-crawler web-crawler web-scraper web-scraping headless-chrome
Created 2018-01-07
858 commits to main branch, last one 5 days ago
mendableai
firecrawl-app-examples mendableai
9
43
unknown
1
🔥 This repository contains complete application examples, including websites and other projects, developed using Firecrawl.
ai llm rag data examples markdown scrapers templates ai-scraping web-crawler html-to-markdown
Created 2024-06-22
5 commits to main branch, last one 5 months ago