9 results found Sort:

pemistahl
lingua-py pemistahl
45
1.2k
apache-2.0
10
The most accurate natural language detection library for Python, suitable for short text and mixed-language text
nlp python-library language-detection language-recognition language-classification language-identification natural-language-processing
Created 2021-07-13
184 commits to main branch, last one 4 months ago
pemistahl
lingua-go pemistahl
67
1.2k
apache-2.0
11
The most accurate natural language detection library for Go, suitable for short text and mixed-language text
go nlp golang-library text-processing language-modeling language-detection language-processing language-recognition nlp-machine-learning language-classification language-identification natural-language-processing
Created 2020-11-27
108 commits to main branch, last one about a month ago
pemistahl
lingua-rs pemistahl
42
917
apache-2.0
9
The most accurate natural language detection library for Rust, suitable for short text and mixed-language text
nlp rust rust-crate rust-library language-detection language-processing language-recognition nlp-machine-learning language-classification language-identification natural-language-processing
Created 2020-06-17
459 commits to main branch, last one 4 days ago
pemistahl
lingua pemistahl
66
723
apache-2.0
11
The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike
nlp nlp-library java-library kotlin-library android-library natural-language language-detection language-processing language-recognition nlp-machine-learning language-classification language-identification natural-language-processing
Created 2018-11-15
541 commits to main branch, last one about a month ago
oscar-project
ungoliant oscar-project
14
166
apache-2.0
2
:spider: The pipeline for the OSCAR corpus
nlp oscar crawler fasttext commoncrawl common-crawl corpus-linguistics language-classification
Created 2021-02-15
419 commits to main branch, last one about a year ago
cisnlp
GlotLID cisnlp
8
111
apache-2.0
5
Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
lid glot glotcc langid glotlid multlingual low-resource-nlp language-detector language-detection language-identifier language-recognition language-detection-lib low-resource-languages language-classification language-identification language-detection-library language-identification-toolkit
Created 2023-09-26
17 commits to main branch, last one 2 months ago
oscar-project
goclassy oscar-project
6
86
apache-2.0
9
An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.
nlp fasttext common-crawl corpus-linguistics language-classification
This repository has been archived (exclude archived)
Created 2019-03-01
17 commits to master branch, last one 3 years ago
JasonFengGit
RNN-Language-Classifier JasonFengGit
12
56
mit
11
A Language Classifier powered by Recurrent Neural Network implemented in Python without AI libraries. AI from scratch.
rnn numpy word-classifier artificial-intelligence language-classification recurrent-neural-network
Created 2020-10-09
19 commits to master branch, last one 3 years ago
nitotm
efficient-language-detector nitotm
4
45
apache-2.0
3
Fast and accurate natural language detection. Detector written in PHP. Nito-ELD, ELD.
nlp php language natural-language language-detector language-detection language-classification language-identification natural-language-processing
Created 2023-05-21
41 commits to main branch, last one 3 months ago