Search Results - RepositoryStats

216

2.7k

apache-2.0

22

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

gpt llm nlp llama deep-learning model-serving openai-triton

Created 2023-07-22

399 commits to main branch, last one 8 hours ago

stable-fast chengzeyi

75

1.2k

mit

17

Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

cuda torch pytorch diffusers deeplearnng openai-triton stable-diffusion inference-engines stable-video-diffusion performance-optimizations

Created 2023-10-17

277 commits to main branch, last one 24 days ago

attorch BobMcDear

24

498

mit

11

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

cuda openai triton pytorch deep-learning openai-triton machine-learning

Created 2023-07-13

158 commits to main branch, last one about a month ago

hip-attention DeepAuto-AI

3

27

unknown

5

Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.

triton attention hip-attention openai-triton attention-mechanism sub-quadratic-attention

Created 2024-02-29

904 commits to main branch, last one 16 days ago