howl-anderson / MicroTokenizer

一个轻量且功能全面的中文分词器，帮助学生了解分词器的工作原理。MicroTokenizer: A lightweight Chinese tokenizer designed for educational and research purposes. Provides a practical, hands-on approach to understanding NLP concepts, featuring multiple tokenization algorithms and customizable models. Ideal for students, researchers, and NLP enthusiasts..

Date Created 2018-06-12 (6 years ago)

Commits 396 (last one 2 months ago)

Stargazers 147 (0 this week)

Watchers 9 (0 this week)

Forks 22

License mit

Ranking

RepositoryStats indexes 598,732 repositories, of these howl-anderson/MicroTokenizer is ranked #226,327 (62nd percentile) for total stargazers, and #226,277 for total watchers. Github reports the primary language for this repository as Python, for repositories using this language it is ranked #41,291/120,199.

Other Information

howl-anderson/MicroTokenizer has 1 open pull request on Github, 0 pull requests have been merged over the lifetime of the repository.

Github issues are enabled, there is 1 open issue and 3 closed issues.

Homepage URL: https://nlp.xiaoquankong.ai

All Topics

tokenizer chinese-nlp dag-network chinese-tokenizer educational-project nlp-machine-learning chinese-word-segmentation

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

9 commits on the default branch (master) since jan '22

Yearly Commits

Commits to the default branch (master) per year

Issue History

Languages

The primary language is Python but there's also others...

updated: 2024-12-24 @ 09:44pm, id: 137062055 / R_kgDOCCtmpw