2 results found Sort:

DefTruth
Awesome-LLM-Inference DefTruth
175
2.6k
gpl-3.0
85
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
llm llms sora vllm deepseek open-sora awesome-llm tensorrt-llm llm-inference flash-attention paged-attention flash-attention-2 flash-attention-3
Created 2023-08-27
390 commits to main branch, last one 22 hours ago
DefTruth
CUDA-Learn-Notes DefTruth
126
1.2k
gpl-3.0
14
🎉 Modern CUDA Learn Notes with PyTorch: fp32, fp16, bf16, fp8/int8, flash_attn, sgemm, sgemv, warp/block reduce, dot, elementwise, softmax, layernorm, rmsnorm.
cuda gemm gemv triton pytorch rmsnorm softmax layernorm elementwise warp-reduce block-reduce flash-attention cuda-programming flash-attention-2 flash-attention-3
Created 2022-12-17
227 commits to main branch, last one 12 hours ago