VKCOM / YouTokenToMe

Unsupervised text tokenizer focused on computational efficiency

Date Created 2019-06-06 (5 years ago)

Commits 85 (last one about a year ago)

Stargazers 946 (0 this week)

Watchers 26 (0 this week)

Forks 95

License mit

This repository has been archived on Github

Ranking

RepositoryStats indexes 528,822 repositories, of these VKCOM/YouTokenToMe is ranked #50,385 (90th percentile) for total stargazers, and #83,055 for total watchers. Github reports the primary language for this repository as C++, for repositories using this language it is ranked #2,673/28,451.

VKCOM/YouTokenToMe is also tagged with popular topics, for these it's ranked: nlp (#345/2238), natural-language-processing (#230/1315)

Other Information

VKCOM/YouTokenToMe has 9 open pull requests on Github, 33 pull requests have been merged over the lifetime of the repository.

Github issues are enabled, there are 32 open issues and 28 closed issues.

There have been 4 releases, the latest one was published on 2020-02-13 (4 years ago) with the name Memory usage improved.

All Topics

bpe nlp tokenization word-segmentation natural-language-processing

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

6 commits on the default branch (master) since jan '22

Yearly Commits

Commits to the default branch (master) per year

Issue History

Languages

The primary language is C++ but there's also others...

updated: 2024-06-07 @ 04:28am, id: 190571154 / R_kgDOC1vikg