DefTruth / Awesome-LLM-Inference

📖A curated list of Awesome LLM/VLM Inference Papers with codes, such as FlashAttention, PagedAttention, Parallelism, etc. 🎉🎉

Date Created 2023-08-27 (about a year ago)

Commits 428 (last one 13 days ago)

Stargazers 3,024 (24 this week)

Watchers 102 (1 this week)

Forks 206

License gpl-3.0

Ranking

RepositoryStats indexes 595,856 repositories, of these DefTruth/Awesome-LLM-Inference is ranked #16,766 (97th percentile) for total stargazers, and #17,580 for total watchers.

DefTruth/Awesome-LLM-Inference is also tagged with popular topics, for these it's ranked: llm (#209/2913), llms (#42/537), llm-inference (#14/171)

Other Information

There have been 33 releases, the latest one was published on 2024-12-09 (13 days ago) with the name v2.6.8.

All Topics

llm llms sora vllm deepseek open-sora awesome-llm tensorrt-llm llm-inference flash-attention paged-attention flash-attention-2 flash-attention-3

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

428 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

We don't have any language data for this repository

It's a mystery

updated: 2024-12-21 @ 04:19pm, id: 683573931 / R_kgDOKL6Cqw