10 results found Sort:

adbar
trafilatura adbar
232
3.1k
apache-2.0
30
Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
nlp tei news corpus crawler rss-feed scraping html2text readability text-mining corpus-tools news-crawler web-scraping text-cleaning corpus-builder news-aggregator text-extraction html-to-markdown article-extractor text-preprocessing
Created 2019-04-08
1,513 commits to master branch, last one 2 days ago
BLKSerene
Wordless BLKSerene
87
673
gpl-3.0
29
An Integrated Corpus Tool With Multilingual Support for the Study of Language, Literature, and Translation
corpus tagger stopword tokenizer lemmatizer literature linguistics translation corpus-tools corpus-search corpus-analysis corpus-processing corpus-statistics dependency-parser corpus-linguistics
Created 2018-08-23
1,404 commits to main branch, last one a day ago
bitextor
bitextor bitextor
43
283
gpl-3.0
30
Bitextor generates translation memories from multilingual websites
tmx warc wget crawler apertium bitextor hunalign bicleaner bleualign tokenizer corpus-tools dictionaries corpus-generator document-aligner parallel-corpora corpus-processing machine-translation sentence-segmentation neural-machine-translation statistical-machine-translation
Created 2018-04-16
3,994 commits to master branch, last one 9 months ago
grammarly
ua-gec grammarly
21
255
cc-by-4.0
13
UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language
gec corpus dataset corpus-data corpus-tools nlp-datasets ukrainian-language natural-language-processing grammatical-error-correction
Created 2021-01-19
114 commits to main branch, last one 4 months ago
ynop
audiomate ynop
26
130
mit
11
Python library for handling audio datasets.
audio music noise speech data-loader corpus-tools audio-datasets dataset-manager dataset-creation dataset-filtering speech-recognition
Created 2017-11-27
600 commits to master branch, last one 3 years ago
adbar
simplemma adbar
10
130
mit
7
Simple multilingual lemmatizer for Python, especially useful for speed and efficiency
nlp wordlist tokenizer lemmatiser lemmatizer corpus-tools tokenization lemmatization low-resource-nlp language-detection morphological-analysis language-identification
Created 2021-01-18
217 commits to main branch, last one 7 days ago
Helsinki-NLP
OpusFilter Helsinki-NLP
18
97
mit
11
OpusFilter - Parallel corpus processing toolkit
nlp corpus-tools parallel-corpus corpus-processing machine-translation natural-language-processing
Created 2019-11-06
252 commits to develop branch, last one 8 days ago
NathanDuran
Switchboard-Corpus NathanDuran
14
66
gpl-3.0
1
Utilities for Processing the Switchboard Dialogue Act Corpus
corpus dialogue dialogues corpus-data switchboard corpus-tools dialogue-act dialogue-data corpus-processing switchboard-corpus
Created 2018-11-14
48 commits to master branch, last one 3 years ago
czcorpus
kontext czcorpus
22
59
gpl-2.0
10
An advanced, extensible web front-end for the Manatee-open corpus search engine
corpora corpus-tools user-interface corpus-linguistics
Created 2015-04-14
12,490 commits to master branch, last one a day ago
lennes
spect lennes
11
53
gpl-3.0
5
SpeCT - Speech Corpus Toolkit for Praat. Documentation: https://lennes.github.io/spect/
praat spect speech analysis annotation transcript corpus-tools speech-corpus transcription speech-analysis spoken-language corpus-linguistics conversational-speech
Created 2017-03-08
49 commits to master branch, last one 10 months ago