Search Results - RepositoryStats

64

1.1k

apache-2.0

11

The most accurate natural language detection library for Go, suitable for short text and mixed-language text

go nlp golang-library text-processing language-modeling language-detection language-processing language-recognition nlp-machine-learning language-classification language-identification natural-language-processing

Created 2020-11-27

101 commits to main branch, last one 5 months ago

lingua-py pemistahl

43

991

apache-2.0

12

The most accurate natural language detection library for Python, suitable for short text and mixed-language text

nlp python-library language-detection language-recognition language-classification language-identification natural-language-processing

Created 2021-07-13

183 commits to main branch, last one 2 months ago

lingua-rs pemistahl

35

848

apache-2.0

8

The most accurate natural language detection library for Rust, suitable for short text and mixed-language text

nlp rust rust-crate rust-library language-detection language-processing language-recognition nlp-machine-learning language-classification language-identification natural-language-processing

Created 2020-06-17

402 commits to main branch, last one 2 months ago

lingua pemistahl

60

665

apache-2.0

11

The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike

nlp nlp-library java-library kotlin-library android-library natural-language language-detection language-processing language-recognition nlp-machine-learning language-classification language-identification natural-language-processing

Created 2018-11-15

512 commits to main branch, last one 4 months ago

ungoliant oscar-project

14

154

apache-2.0

2

:spider: The pipeline for the OSCAR corpus

nlp oscar crawler fasttext commoncrawl common-crawl corpus-linguistics language-classification

Created 2021-02-15

419 commits to main branch, last one 7 months ago

goclassy oscar-project

6

85

apache-2.0

9

An asynchronous concurrent pipeline for classifying Common Crawl based on fastText's pipeline.

nlp fasttext common-crawl corpus-linguistics language-classification

This repository has been archived (exclude archived)

Created 2019-03-01

17 commits to master branch, last one 3 years ago

GlotLID cisnlp

6

76

apache-2.0

4

GlotLID: Language Identification with Support for More Than 2000 Labels -- EMNLP 2023

lid glot langid multlingual low-resource-nlp language-detector language-detection language-identifier language-recognition language-detection-lib low-resource-languages language-classification language-identification language-detection-library language-identification-toolkit

Created 2023-09-26

13 commits to main branch, last one about a month ago

RNN-Language-Classifier JasonFengGit

12

55

mit

11

A Language Classifier powered by Recurrent Neural Network implemented in Python without AI libraries. AI from scratch.

rnn numpy word-classifier artificial-intelligence language-classification recurrent-neural-network

Created 2020-10-09

19 commits to master branch, last one 2 years ago