DefTruth / Awesome-LLM-Inference

📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, Flash-Attention, Paged-Attention, MLA, PP/TP/SP/CP/EP Parallelism, Prefix Cache, Chunked-Prefill, etc. 🎉🎉

Date Created 2023-08-27 (about a year ago)

Commits 458 (last one 17 days ago)

Stargazers 3,681 (37 this week)

Watchers 116 (0 this week)

Forks 259

License gpl-3.0

Ranking

RepositoryStats indexes 629,376 repositories, of these DefTruth/Awesome-LLM-Inference is ranked #14,003 (98th percentile) for total stargazers, and #14,807 for total watchers.

DefTruth/Awesome-LLM-Inference is also tagged with popular topics, for these it's ranked: llm-inference (#14/199)

Other Information

There have been 38 releases, the latest one was published on 2025-02-19 (29 days ago) with the name v2.6.13.

All Topics

mla vllm deepseek flash-mla minimax-01 awesome-llm deepseek-r1 deepseek-v3 tensorrt-llm llm-inference flash-attention paged-attention flash-attention-3

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

458 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

We don't have any language data for this repository

It's a mystery

Opengraph Image

updated: 2025-03-20 @ 05:39pm, id: 683573931 / R_kgDOKL6Cqw