Search Results - RepositoryStats

firecrawl mendableai

1.4k

18.3k

agpl-3.0

96

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

ai llm rag data crawler scraper markdown scraping ai-scraping web-crawler webscraping html-to-markdown

Created 2024-04-15

2,154 commits to main branch, last one a day ago

turndown mixmark-io

879

8.8k

mit

123

🛏 An HTML to Markdown converter written in JavaScript

gfm html node browser markdown commonmark javascript html-to-markdown

Created 2011-10-23

448 commits to master branch, last one 5 months ago

trafilatura adbar

258

3.6k

apache-2.0

31

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Created 2019-04-08

1,570 commits to master branch, last one 2 days ago

flexmark-java vsch

270

2.3k

bsd-2-clause

58

CommonMark/Markdown Java parser with source level AST. CommonMark 0.28, emulation of: pegdown, kramdown, markdown.pl, MultiMarkdown. With HTML to MD, MD to PDF, MD to DOCX conversion modules.

java pegdown markdown commonmark markdown-parser markdown-to-pdf html-to-markdown markdown-flavors markdown-to-html markdown-processor markdown-conversion

Created 2016-01-23

1,813 commits to master branch, last one about a year ago

html-to-markdown JohannesKaufmann

85

890

mit

11

⚙️ Convert HTML to Markdown. Even works with entire websites and can be extended through rules.

go cli html golang markdown converter html-to-markdown

Created 2018-05-15

131 commits to main branch, last one 9 hours ago

html2md helloworld-Co

183

676

unknown

11

helloworld 开发者社区开源的一个轻量级，强大的 html 一键转 md 工具，支持多平台文章一键转换，并保存下载到本地。

md vue csdn html node nuxt jsdom juejin markdown javascript html-to-markdown markdown-to-html

Created 2021-02-05

25 commits to main branch, last one 5 months ago

breakdance breakdance

28

520

mit

23

It's time for your markup to get down! HTML to markdown converter. Breakdance is a highly pluggable, flexible and easy to use.

gfm html parse marked markup render compile convert markdown turndown converter commonmark remarkable markdown-it to-markdown html-to-markdown

Created 2017-02-01

135 commits to master branch, last one 5 years ago

clipper.js philschmid

33

487

apache-2.0

4

HTML to Markdown converter and crawler.

nlp crawl search markdown html-to-markdown retrieval-augmented-generation

Created 2023-09-27

24 commits to main branch, last one 10 months ago

copy-as-markdown notlmn

49

326

mit

8

🖱 Browser extension to copy hyperlinks, images, and selected text as Markdown with GFM support

markdown firefox-addon chrome-extension html-to-markdown browser-extension

Created 2019-06-27

33 commits to master branch, last one 29 days ago

markdown-crawler paulpierre

30

304

mit

4

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

llm rag llmops html2md markdown md-crawler web-scraper markdown-parser html-to-markdown markdown-crawler markdown-scraper html-to-markdown-converter

Created 2023-10-24

14 commits to main branch, last one about a year ago

reader mrusme

11

281

gpl-3.0

5

reader is for your command line what the “readability” view is for modern browsers: A lightweight tool offering better readability of web pages on the CLI.