Statistics for topic llm-serving

RepositoryStats tracks 584,797 Github repositories, of these 31 are tagged with the llm-serving topic. The most common primary language for repositories using this topic is Python (16).

Stargazers over time for topic llm-serving

Most starred repositories for topic llm-serving (view more)

5.8k
34.1k
apache-2.0
474
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Created 2016-10-25
23,079 commits to master branch, last one 14 hours ago
4.6k
30.5k
apache-2.0
248
A high-throughput and memory-efficient inference and serving engine for LLMs
Created 2023-02-09
3,511 commits to main branch, last one 11 hours ago
1.1k
10.8k
apache-2.0
95
本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
Created 2023-05-23
898 commits to main branch, last one 17 days ago
639
10.1k
apache-2.0
56
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
Created 2023-04-19
1,821 commits to main branch, last one 2 days ago
792
7.2k
apache-2.0
77
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Created 2019-04-02
3,365 commits to main branch, last one a day ago
513
6.8k
apache-2.0
70
SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.
Created 2021-08-11
2,135 commits to master branch, last one 23 hours ago

Trending repositories for topic llm-serving (view more)