Statistics for topic llm-serving

RepositoryStats tracks 533,807 Github repositories, of these 28 are tagged with the llm-serving topic. The most common primary language for repositories using this topic is Python (16).

Stargazers over time for topic llm-serving

Most starred repositories for topic llm-serving (view more)

5.4k
31.9k
apache-2.0
473
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Created 2016-10-25
22,000 commits to master branch, last one 8 hours ago
3.0k
21.7k
apache-2.0
197
A high-throughput and memory-efficient inference and serving engine for LLMs
Created 2023-02-09
1,718 commits to main branch, last one 8 hours ago
586
9.2k
apache-2.0
53
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
Created 2023-04-19
1,579 commits to main branch, last one 2 days ago
722
7.4k
apache-2.0
75
本项目旨在分享大模型相关技术原理以及实战经验。
Created 2023-05-23
867 commits to main branch, last one 2 days ago
764
6.8k
apache-2.0
74
The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
Created 2019-04-02
3,150 commits to main branch, last one 2 days ago
424
6.1k
apache-2.0
68
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
Created 2021-08-11
1,833 commits to master branch, last one a day ago

Trending repositories for topic llm-serving (view more)