1 result found Sort:

DefTruth
Awesome-LLM-Inference DefTruth
129
1.8k
gpl-3.0
71
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
llm llms sora vllm deepseek open-sora awesome-llm tensorrt-llm llm-inference streaming-llm flash-attention paged-attention flash-attention-2
Created 2023-08-27
293 commits to main branch, last one a day ago