zhihu / ZhiLight

A highly optimized LLM inference acceleration engine for Llama and its variants.

Date Created 2024-12-06 (15 days ago)
Commits 19 (last one 5 days ago)
Stargazers 392 (43 this week)
Watchers 9 (1 this week)
Forks 30
License apache-2.0
Ranking

RepositoryStats indexes 595,890 repositories, of these zhihu/ZhiLight is ranked #109,733 (82nd percentile) for total stargazers, and #225,768 for total watchers. Github reports the primary language for this repository as C++, for repositories using this language it is ranked #6,125/31,840.

zhihu/ZhiLight is also tagged with popular topics, for these it's ranked: pytorch (#1,619/6025),  llm (#814/2911),  gpt (#315/1145),  cuda (#198/652),  llama (#202/545)

Other Information

zhihu/ZhiLight has Github issues enabled, there are 3 open issues and 6 closed issues.

There have been 1 release, the latest one was published on 2024-12-10 (11 days ago) with the name v0.4.8.

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

19 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

The primary language is C++ but there's also others...

updated: 2024-12-20 @ 11:04am, id: 899491463 / R_kgDONZ0mhw