1 result found Sort:

paulpierre
markdown-crawler paulpierre
21
196
mit
4
A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG
llm rag llmops html2md markdown md-crawler web-scraper markdown-parser html-to-markdown markdown-crawler markdown-scraper html-to-markdown-converter
Created 2023-10-24
14 commits to main branch, last one 7 months ago