cahya-wirawan / rwkv-tokenizer

A fast RWKV Tokenizer written in Rust

Date Created 2024-05-29 (8 months ago)

Commits 86 (last one 4 months ago)

Stargazers 40 (2 this week)

Watchers 2 (0 this week)

Forks 2

License apache-2.0

Ranking

RepositoryStats indexes 608,301 repositories, of these cahya-wirawan/rwkv-tokenizer is ranked #529,430 (13th percentile) for total stargazers, and #492,633 for total watchers. Github reports the primary language for this repository as Jupyter Notebook, for repositories using this language it is ranked #14,651/18,053.

cahya-wirawan/rwkv-tokenizer is also tagged with popular topics, for these it's ranked: llm (#2,527/3093), huggingface (#311/395)

Other Information

Homepage URL: https://github.com/cahya-wirawan/rwkv-tokenizer

All Topics

llm rwkv trie tiktoken tokenizer huggingface

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

86 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

No issues have been posted

Languages

The primary language is Jupyter Notebook but there's also others...

updated: 2025-01-27 @ 10:45pm, id: 807635813 / R_kgDOMCOLZQ