cahya-wirawan / rwkv-tokenizer

A fast RWKV Tokenizer written in Rust

Date Created 2024-05-29 (about a month ago)

Commits 73 (last one 11 days ago)

Stargazers 29 (2 this week)

Watchers 1 (0 this week)

Forks 2

License apache-2.0

Ranking

RepositoryStats indexes 534,880 repositories, of these cahya-wirawan/rwkv-tokenizer is ranked #520,229 (3rd percentile) for total stargazers, and #497,515 for total watchers. Github reports the primary language for this repository as Jupyter Notebook, for repositories using this language it is ranked #14,327/14,941.

cahya-wirawan/rwkv-tokenizer is also tagged with popular topics, for these it's ranked: llm (#1,908/2049)

Other Information

Homepage URL: https://github.com/cahya-wirawan/rwkv-tokenizer

All Topics

llm rwkv trie tiktoken tokenizer huggingface

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

73 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

No issues have been posted

Languages

The primary language is Jupyter Notebook but there's also others...

updated: 2024-07-01 @ 12:32pm, id: 807635813 / R_kgDOMCOLZQ