12 results found Sort:

undertheseanlp
underthesea undertheseanlp
281
1.5k
gpl-3.0
80
Underthesea - Vietnamese NLP Toolkit
ner nlp vietnamese nlp-library pos-tagging vietnamese-nlp word-segmenter dependency-parser dependency-parsing vietnamese-tokenizer sentence-segmentation named-entity-recognition natural-language-processing
Created 2017-03-01
864 commits to main branch, last one about a month ago
natasha
natasha natasha
109
1.2k
mit
57
Solves basic Russian NLP tasks, API for lower level Natasha projects
ner nlp python syntax russian tokenizer embeddings morphology visualization sentence-segmentation
Created 2016-08-03
413 commits to master branch, last one 6 months ago
segment-any-text
wtpsplit segment-any-text
56
991
mit
13
Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.
python deep-learning machine-learning pretrained-models sentence-segmenter sentence-segmentation natural-language-processing sentence-boundary-detection
Created 2020-01-31
803 commits to main branch, last one 23 days ago
nlp-uoregon
trankit nlp-uoregon
103
749
apache-2.0
25
Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
nlp pytorch adapters xlm-roberta deeplearning multilingual tokenization lemmatization language-model machine-learning dependency-parsing morphological-tagging sentence-segmentation part-of-speech-tagging universal-dependencies artificial-intelligence natural-language-processing
Created 2021-01-08
114 commits to master branch, last one 6 months ago
vncorenlp
VnCoreNLP vncorenlp
149
614
other
30
A Vietnamese natural language processing toolkit (NAACL 2018)
ner nlp java parsing python3 vnmarmot vncorenlp pos-tagger vietnamese pos-tagging rdrsegmenter vietnamese-nlp word-segmenter word-segmentation dependency-parsing vietnamese-tokenizer sentence-segmentation named-entity-recognition natural-language-processing
Created 2017-12-30
46 commits to master branch, last one 2 years ago
bitextor
bitextor bitextor
43
292
gpl-3.0
29
Bitextor generates translation memories from multilingual websites
tmx warc wget crawler apertium bitextor hunalign bicleaner bleualign tokenizer corpus-tools dictionaries corpus-generator document-aligner parallel-corpora corpus-processing machine-translation sentence-segmentation neural-machine-translation statistical-machine-translation
Created 2018-04-16
4,001 commits to master branch, last one 5 months ago
natasha
razdel natasha
32
266
mit
15
Rule-based token, sentence segmentation for Russian language
nlp python russian tokenization sentence-segmentation sentence-boundary-detection
Created 2018-11-10
98 commits to master branch, last one about a year ago
milaan9
Python_Natural_Language_Processing milaan9
175
198
mit
1
This repository consists of a complete guide on natural language processing (NLP) in Python where we'll learn various techniques for implementing NLP including parsing & text processing and understand...
nlp tf-idf stemming stopwords bag-of-words tokenization lemmatization termfrequency tutor-milaan9 ipython-notebook python4everybody python4datascience partofspeech-tagger vocabulary-matching sentence-segmentation inversedocumentfrequency named-entity-recognition
Created 2021-11-08
19 commits to main branch, last one 2 years ago
ckiplab
ckipnlp ckiplab
14
121
gpl-3.0
8
CKIP CoreNLP Toolkits
nlp ckip sentence-parsing word-segmentation sentence-segmentation coreference-resolution part-of-speech-tagging named-entity-recognition
Created 2019-04-01
259 commits to master branch, last one 2 years ago
PKU-TANGENT
NeuralEDUSeg PKU-TANGENT
44
102
apache-2.0
4
A toolkit for discourse segmentation (EDU segmentation).
discourse neural-network edu-segmentation sentence-segmentation discourse-segmentation
Created 2018-08-27
10 commits to master branch, last one 6 years ago
wikimedia
sentencex wikimedia
6
61
mit
3
A sentence segmentation library with wide language support optimized for speed and utility.
nlp sentence sentence-segmentation natural-language-processing
Created 2023-08-11
53 commits to master branch, last one 7 months ago
sentencizer
sentencizer sentencizer
6
32
mit
1
A sentence splitting (sentence boundary disambiguation) library for Go. It is rule-based and works out-of-the-box.
ai llm rag golang nlp-library text-splitter text-splitting sentence-splitter sentence-segmenter sentence-splitting sentence-tokenizer sentence-segmentation natural-language-processing sentence-boundary-detection retrieval-augmented-generation
Created 2024-02-14
45 commits to main branch, last one 20 days ago