DefTruth / Awesome-LLM-Inference

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

Date Created 2023-08-27 (9 months ago)

Commits 279 (last one 2 days ago)

Stargazers 1,607 (92 this week)

Watchers 62 (2 this week)

Forks 120

License gpl-3.0

Ranking

RepositoryStats indexes 523,840 repositories, of these DefTruth/Awesome-LLM-Inference is ranked #30,293 (94th percentile) for total stargazers, and #31,763 for total watchers.

DefTruth/Awesome-LLM-Inference is also tagged with popular topics, for these it's ranked: llm (#237/1875), llms (#40/351), llm-inference (#20/109)

Other Information

DefTruth/Awesome-LLM-Inference has Github issues enabled, there is 1 open issue and 3 closed issues.

There have been 9 releases, the latest one was published on 2024-05-27 (5 days ago) with the name v0.9.

Homepage URL: https://github.com/DefTruth/Awesome-LLM-Inference

All Topics

llm llms sora vllm deepseek open-sora awesome-llm tensorrt-llm llm-inference streaming-llm flash-attention paged-attention flash-attention-2

Star History

Github stargazers over time

Watcher History

Github watchers over time, collection started in '23

Recent Commit History

279 commits on the default branch (main) since jan '22

Yearly Commits

Commits to the default branch (main) per year

Issue History

Languages

We don't have any language data for this repository

It's a mystery

updated: 2024-05-31 @ 09:23pm, id: 683573931 / R_kgDOKL6Cqw