Search Results - RepositoryStats

2 results found Sort:

665

7.2k

apache-2.0

SGLang is a fast serving framework for large language models and vision language models.

llm moe vlm cuda llama llava llama2 llama3 pytorch deepseek llama3-1 inference deepseek-v3 llm-serving transformer deepseek-llm

Created 2024-01-08

1,662 commits to main branch, last one about an hour ago

211

3.1k

gpl-3.0

106

📖A curated list of Awesome LLM/VLM Inference Papers with codes, such as FlashAttention, PagedAttention, Parallelism, etc. 🎉🎉

llm llms sora vllm deepseek awesome-llm deepseek-v3 tensorrt-llm llm-inference flash-attention paged-attention flash-attention-2 flash-attention-3

Created 2023-08-27

437 commits to main branch, last one 2 hours ago