2 results found Sort:

DefTruth
Awesome-LLM-Inference DefTruth
175
2.6k
gpl-3.0
85
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
llm llms sora vllm deepseek open-sora awesome-llm tensorrt-llm llm-inference flash-attention paged-attention flash-attention-2 flash-attention-3
Created 2023-08-27
390 commits to main branch, last one a day ago
DefTruth
Awesome-SD-Inference DefTruth
3
70
gpl-3.0
5
📖A small curated list of Awesome SD/DiT/ViT/Diffusion Inference with Distributed/Caching/Sampling: DistriFusion, PipeFusion, AsyncDiff, DeepCache, Block Caching etc.
dit gpu vit sd15 sdxl sora deepcache diffusion inference open-sora multi-gpus open-sora-plan stable-diffusion
Created 2024-01-14
40 commits to main branch, last one 21 days ago