Statistics for topic llm-serving

RepositoryStats tracks 579,129 Github repositories, of these 31 are tagged with the llm-serving topic. The most common primary language for repositories using this topic is Python (16).

Stargazers over time for topic llm-serving

Most starred repositories for topic llm-serving (view more)

5.7k
33.8k
apache-2.0
474
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Created 2016-10-25
22,969 commits to master branch, last one 8 hours ago
4.5k
29.7k
apache-2.0
242
A high-throughput and memory-efficient inference and serving engine for LLMs
Created 2023-02-09
3,290 commits to main branch, last one 7 hours ago
1.0k
10.4k
apache-2.0
88
本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
Created 2023-05-23
898 commits to main branch, last one 3 days ago
635
10.0k
apache-2.0
56
Run any open-source LLMs, such as Llama, Gemma, as OpenAI compatible API endpoint in the cloud.
Created 2023-04-19
1,818 commits to main branch, last one a day ago
792
7.1k
apache-2.0
77
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Created 2019-04-02
3,343 commits to main branch, last one 21 hours ago
502
6.8k
apache-2.0
71
SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
Created 2021-08-11
2,082 commits to master branch, last one 7 hours ago

Trending repositories for topic llm-serving (view more)