3 results found Sort:

DefTruth
Awesome-LLM-Inference DefTruth
129
1.8k
gpl-3.0
71
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
llm llms sora vllm deepseek open-sora awesome-llm tensorrt-llm llm-inference streaming-llm flash-attention paged-attention flash-attention-2
Created 2023-08-27
293 commits to main branch, last one a day ago
DefTruth
CUDA-Learn-Notes DefTruth
81
806
gpl-3.0
10
🎉CUDA 笔记 / 大模型手撕CUDA / C++笔记，更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.
cuda gemm gemv rmsnorm softmax layernorm elementwise warp-reduce block-reduce cuda-kernels flash-attention cuda-programming flash-attention-2
Created 2022-12-17
110 commits to main branch, last one a day ago
arihanv
Shush arihanv
26
146
mit
4
Shush is an app that deploys a WhisperV3 model with Flash Attention v2 on Modal and makes requests to it via a NextJS app
modal whisper shadcn-ui transcription machine-learning flash-attention-2 huggingface-transformers
Created 2023-11-18
64 commits to main branch, last one 22 days ago