Search Results - RepositoryStats

firecrawl mendableai

1.6k

20.3k

agpl-3.0

111

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

ai llm rag data crawler scraper markdown scraping ai-scraping web-crawler webscraping html-to-markdown

Created 2024-04-15

2,473 commits to main branch, last one 20 hours ago

turndown mixmark-io

887

9.0k

mit

123

🛏 An HTML to Markdown converter written in JavaScript

gfm html node browser markdown commonmark javascript html-to-markdown

Created 2011-10-23

448 commits to master branch, last one 7 months ago

trafilatura adbar

266

3.7k

apache-2.0

30

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Created 2019-04-08

1,586 commits to master branch, last one 10 days ago

html-to-markdown JohannesKaufmann

128

2.5k

mit

13

⚙️ Convert HTML to Markdown. Even works with entire websites and can be extended through rules.

go cli html golang markdown converter html-to-markdown

Created 2018-05-15

145 commits to main branch, last one 5 days ago

flexmark-java vsch

275

2.3k

bsd-2-clause

58

CommonMark/Markdown Java parser with source level AST. CommonMark 0.28, emulation of: pegdown, kramdown, markdown.pl, MultiMarkdown. With HTML to MD, MD to PDF, MD to DOCX conversion modules.

java pegdown markdown commonmark markdown-parser markdown-to-pdf html-to-markdown markdown-flavors markdown-to-html markdown-processor markdown-conversion

Created 2016-01-23

1,813 commits to master branch, last one about a year ago

html2md helloworld-Co

185

692

unknown

11

helloworld 开发者社区开源的一个轻量级，强大的 html 一键转 md 工具，支持多平台文章一键转换，并保存下载到本地。

md vue csdn html node nuxt jsdom juejin markdown javascript html-to-markdown markdown-to-html

Created 2021-02-05

25 commits to main branch, last one 6 months ago

breakdance breakdance

30

525

mit

24

It's time for your markup to get down! HTML to markdown converter. Breakdance is a highly pluggable, flexible and easy to use.

gfm html parse marked markup render compile convert markdown turndown converter commonmark remarkable markdown-it to-markdown html-to-markdown

Created 2017-02-01

135 commits to master branch, last one 5 years ago

clipper.js philschmid

34

493

apache-2.0

4

HTML to Markdown converter and crawler.

nlp crawl search markdown html-to-markdown retrieval-augmented-generation

Created 2023-09-27

24 commits to main branch, last one 11 months ago

copy-as-markdown notlmn

49

330

mit

8

🖱 Browser extension to copy hyperlinks, images, and selected text as Markdown with GFM support

markdown firefox-addon chrome-extension html-to-markdown browser-extension

Created 2019-06-27

33 commits to master branch, last one 2 months ago

markdown-crawler paulpierre

35

329

mit

5

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

llm rag llmops html2md markdown md-crawler web-scraper markdown-parser html-to-markdown markdown-crawler markdown-scraper html-to-markdown-converter

Created 2023-10-24

14 commits to main branch, last one about a year ago

reader mrusme

12

285

gpl-3.0

5

reader is for your command line what the “readability” view is for modern browsers: A lightweight tool offering better readability of web pages on the CLI.