11 results found Sort:

adbar
trafilatura adbar
266
3.8k
apache-2.0
30
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
llm nlp rag tei crawler rss-feed scraping html2text readability text-mining corpus-tools news-crawler web-scraping text-cleaning corpus-builder news-aggregator text-extraction html-to-markdown article-extractor text-preprocessing
Created 2019-04-08
1,587 commits to master branch, last one a day ago
BLKSerene
Wordless BLKSerene
92
702
gpl-3.0
27
An Integrated Corpus Tool With Multilingual Support for the Study of Language, Literature, and Translation
corpus tagger stopword tokenizer lemmatizer literature linguistics translation corpus-tools corpus-search corpus-analysis corpus-processing corpus-statistics dependency-parser corpus-linguistics
Created 2018-08-23
1,453 commits to main branch, last one 20 days ago
bitextor
bitextor bitextor
43
292
gpl-3.0
30
Bitextor generates translation memories from multilingual websites
tmx warc wget crawler apertium bitextor hunalign bicleaner bleualign tokenizer corpus-tools dictionaries corpus-generator document-aligner parallel-corpora corpus-processing machine-translation sentence-segmentation neural-machine-translation statistical-machine-translation
Created 2018-04-16
4,001 commits to master branch, last one about a month ago
grammarly
ua-gec grammarly
22
255
cc-by-4.0
13
UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language
gec corpus dataset corpus-data corpus-tools nlp-datasets ukrainian-language natural-language-processing grammatical-error-correction
Created 2021-01-19
114 commits to main branch, last one 10 months ago
adbar
simplemma adbar
12
147
mit
7
Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
nlp wordlist tokenizer lemmatiser lemmatizer corpus-tools tokenization lemmatization low-resource-nlp language-detection morphological-analysis language-identification
Created 2021-01-18
233 commits to main branch, last one about a month ago
ynop
audiomate ynop
27
134
mit
11
Python library for handling audio datasets.
audio music noise speech data-loader corpus-tools audio-datasets dataset-manager dataset-creation dataset-filtering speech-recognition
Created 2017-11-27
600 commits to master branch, last one 4 years ago
Helsinki-NLP
OpusFilter Helsinki-NLP
19
103
mit
11
OpusFilter - Parallel corpus processing toolkit
nlp corpus-tools parallel-corpus corpus-processing machine-translation natural-language-processing
Created 2019-11-06
268 commits to develop branch, last one 4 months ago
NathanDuran
Switchboard-Corpus NathanDuran
14
67
gpl-3.0
1
Utilities for Processing the Switchboard Dialogue Act Corpus
corpus dialogue dialogues corpus-data switchboard corpus-tools dialogue-act dialogue-data corpus-processing switchboard-corpus
Created 2018-11-14
48 commits to master branch, last one 3 years ago
czcorpus
kontext czcorpus
22
63
gpl-2.0
11
An advanced, extensible web front-end for the Manatee-open corpus search engine
corpora corpus-tools user-interface corpus-linguistics
Created 2015-04-14
12,928 commits to master branch, last one 11 days ago
lennes
spect lennes
11
56
gpl-3.0
5
SpeCT - Speech Corpus Toolkit for Praat. Documentation: https://lennes.github.io/spect/
praat spect speech analysis annotation transcript corpus-tools speech-corpus transcription speech-analysis spoken-language corpus-linguistics conversational-speech
Created 2017-03-08
49 commits to master branch, last one about a year ago
johentsch
ms3 johentsch
3
44
gpl-3.0
1
A parser for annotated MuseScore 3 files.
tsv corpus parser musescore tsv-files musescore2 musescore3 musescore4 tsv-format xml-parser corpus-data music-score sheet-music xml-parsing corpus-tools music-scores corpus-generator corpus-processing sheet-music-parser xml-parser-library
Created 2020-05-04
1,593 commits to main branch, last one 2 months ago