Statistics for topic llm-serving

RepositoryStats tracks 528,804 Github repositories, of these 27 are tagged with the llm-serving topic. The most common primary language for repositories using this topic is Python (14).

Stargazers over time for topic llm-serving

Most starred repositories for topic llm-serving (view more)

5.4k
31.7k
apache-2.0
472
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Created 2016-10-25
21,862 commits to master branch, last one a day ago
2.9k
20.9k
apache-2.0
197
A high-throughput and memory-efficient inference and serving engine for LLMs
Created 2023-02-09
1,568 commits to main branch, last one 16 hours ago
581
9.1k
apache-2.0
54
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
Created 2023-04-19
1,566 commits to main branch, last one a day ago
696
7.1k
apache-2.0
73
本项目旨在分享大模型相关技术原理以及实战经验。
Created 2023-05-23
860 commits to main branch, last one 6 days ago
758
6.7k
apache-2.0
73
The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
Created 2019-04-02
3,121 commits to main branch, last one a day ago
417
6.1k
apache-2.0
67
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
Created 2021-08-11
1,817 commits to master branch, last one 17 hours ago

Trending repositories for topic llm-serving (view more)