11 results found Sort:

undertheseanlp
underthesea undertheseanlp
275
1.4k
gpl-3.0
80
Underthesea - Vietnamese NLP Toolkit
ner nlp vietnamese nlp-library pos-tagging vietnamese-nlp word-segmenter dependency-parser dependency-parsing vietnamese-tokenizer sentence-segmentation named-entity-recognition natural-language-processing
Created 2017-03-01
863 commits to main branch, last one 3 months ago
natasha
natasha natasha
108
1.2k
mit
59
Solves basic Russian NLP tasks, API for lower level Natasha projects
ner nlp python syntax russian tokenizer embeddings morphology visualization sentence-segmentation
Created 2016-08-03
413 commits to master branch, last one 3 months ago
segment-any-text
wtpsplit segment-any-text
47
834
mit
12
Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.
python deep-learning machine-learning pretrained-models sentence-segmenter sentence-segmentation natural-language-processing sentence-boundary-detection
Created 2020-01-31
797 commits to main branch, last one 5 days ago
nlp-uoregon
trankit nlp-uoregon
102
744
apache-2.0
24
Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
nlp pytorch adapters xlm-roberta deeplearning multilingual tokenization lemmatization language-model machine-learning dependency-parsing morphological-tagging sentence-segmentation part-of-speech-tagging universal-dependencies artificial-intelligence natural-language-processing
Created 2021-01-08
114 commits to master branch, last one 3 months ago
vncorenlp
VnCoreNLP vncorenlp
148
602
other
30
A Vietnamese natural language processing toolkit (NAACL 2018)
ner nlp java parsing python3 vnmarmot vncorenlp pos-tagger vietnamese pos-tagging rdrsegmenter vietnamese-nlp word-segmenter word-segmentation dependency-parsing vietnamese-tokenizer sentence-segmentation named-entity-recognition natural-language-processing
Created 2017-12-30
46 commits to master branch, last one about a year ago
bitextor
bitextor bitextor
43
293
gpl-3.0
30
Bitextor generates translation memories from multilingual websites
tmx warc wget crawler apertium bitextor hunalign bicleaner bleualign tokenizer corpus-tools dictionaries corpus-generator document-aligner parallel-corpora corpus-processing machine-translation sentence-segmentation neural-machine-translation statistical-machine-translation
Created 2018-04-16
4,001 commits to master branch, last one 2 months ago
natasha
razdel natasha
31
251
mit
15
Rule-based token, sentence segmentation for Russian language
nlp python russian tokenization sentence-segmentation sentence-boundary-detection
Created 2018-11-10
98 commits to master branch, last one about a year ago
milaan9
Python_Natural_Language_Processing milaan9
173
197
mit
2
This repository consists of a complete guide on natural language processing (NLP) in Python where we'll learn various techniques for implementing NLP including parsing & text processing and understand...
nlp tf-idf stemming stopwords bag-of-words tokenization lemmatization termfrequency tutor-milaan9 ipython-notebook python4everybody python4datascience partofspeech-tagger vocabulary-matching sentence-segmentation inversedocumentfrequency named-entity-recognition
Created 2021-11-08
19 commits to main branch, last one 2 years ago
ckiplab
ckipnlp ckiplab
15
118
gpl-3.0
9
CKIP CoreNLP Toolkits
nlp ckip sentence-parsing word-segmentation sentence-segmentation coreference-resolution part-of-speech-tagging named-entity-recognition
Created 2019-04-01
259 commits to master branch, last one about a year ago
PKU-TANGENT
NeuralEDUSeg PKU-TANGENT
44
102
apache-2.0
5
A toolkit for discourse segmentation (EDU segmentation).
discourse neural-network edu-segmentation sentence-segmentation discourse-segmentation
Created 2018-08-27
10 commits to master branch, last one 5 years ago
wikimedia
sentencex wikimedia
6
55
mit
4
A sentence segmentation library with wide language support optimized for speed and utility.
nlp sentence sentence-segmentation natural-language-processing
Created 2023-08-11
53 commits to master branch, last one 5 months ago