2 results found Sort:

mendableai
firecrawl mendableai
372
5.3k
agpl-3.0
31
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
ai llm rag data crawler scraper markdown scraping ai-scraping web-crawler html-to-markdown
Created 2024-04-15
546 commits to main branch, last one 13 hours ago
spider-rs
spider spider-rs
71
708
mit
11
The fastest web crawler written in Rust. Maintained by @a11ywatch.
rust spider crawler indexer scraping ai-scraping llm-crawler web-crawler headless-chrome
Created 2018-01-07
664 commits to main branch, last one 19 hours ago