Search Results - RepositoryStats

223

2.8k

apache-2.0

22

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

gpt llm nlp llama deep-learning model-serving openai-triton

Created 2023-07-22

434 commits to main branch, last one 4 days ago

stable-fast chengzeyi

76

1.2k

mit

17

Best inference performance optimization framework for HuggingFace Diffusers on NVIDIA GPUs.

cuda torch pytorch diffusers deeplearnng openai-triton stable-diffusion inference-engines stable-video-diffusion performance-optimizations

Created 2023-10-17

277 commits to main branch, last one 2 months ago

attorch BobMcDear

26

511

mit

11

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

cuda openai triton pytorch deep-learning openai-triton machine-learning

Created 2023-07-13

160 commits to main branch, last one 22 hours ago

hip-attention DeepAuto-AI

4

33

other

5

Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.

triton attention hip-attention openai-triton attention-mechanism sub-quadratic-attention

Created 2024-02-29

1,132 commits to deepauto/dev branch, last one a day ago