7 results found Sort:

adbar
trafilatura adbar
266
3.7k
apache-2.0
30
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
llm nlp rag tei crawler rss-feed scraping html2text readability text-mining corpus-tools news-crawler web-scraping text-cleaning corpus-builder news-aggregator text-extraction html-to-markdown article-extractor text-preprocessing
Created 2019-04-08
1,586 commits to master branch, last one 10 days ago
blmoistawinde
HarvestText blmoistawinde
331
2.4k
mit
55
文本挖掘和预处理工具（文本清洗、新词发现、情感分析、实体识别链接、关键词抽取、知识抽取、句法分析等），无监督或弱监督方法
nlp gitee pyhanlp harvesttext unsupervised text-cleaning dependency-parser text-segmentation keyword-extraction new-word-discovery sentiment-analysis text-summarization named-entity-recognition
Created 2018-11-19
98 commits to master branch, last one 7 months ago
jfilter
clean-text jfilter
78
959
other
14
🧹 Python package for text cleaning
nlp python scraping text-cleaning python-package text-normalization text-preprocessing user-generated-content natural-language-processing
Created 2018-12-06
83 commits to main branch, last one 2 years ago
wisupai
e2m wisupai
27
509
apache-2.0
1
E2M converts various file types (doc, docx, epub, html, htm, url, pdf, ppt, pptx, mp3, m4a) into Markdown. It’s easy to install, with dedicated parsers and converters, supporting custom configs. E2M o...
e2m llm doc2x markdown text-cleaning pdf-to-markdown
Created 2024-08-04
190 commits to main branch, last one 3 months ago
currentslab
extractnet currentslab
23
251
mit
6
A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one package
news python text-mining webscraping web-scraping news-articles text-cleaning news-extractor date-extraction news-extraction machine-learning author-extraction content-extraction
Created 2020-12-04
434 commits to master branch, last one 2 years ago
trinker
textclean trinker
26
246
unknown
11
Tools for cleaning and normalizing text data
r regex emoticons data-munging text-analysis text-cleaning
Created 2016-01-07
231 commits to master branch, last one 3 years ago
reZach
grammarify reZach
10
68
mit
5
Grammarify is a npm package that safely cleans up text that has mispellings, improper capitalization, lexical illusions, among other things.
text-cleaning grammar-checker spelling-correction
Created 2018-04-22
31 commits to master branch, last one 2 years ago