Statistics for topic llm-inference

RepositoryStats tracks 579,129 Github repositories, of these 152 are tagged with the llm-inference topic. The most common primary language for repositories using this topic is Python (87). Other languages include: Jupyter Notebook (16),  C++ (13)

Stargazers over time for topic llm-inference

Most starred repositories for topic llm-inference (view more)

7.7k
70.5k
mit
640
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Created 2023-03-27
2,150 commits to main branch, last one a day ago
4.8k
32.7k
cc-by-4.0
388
A programming framework for agentic AI 🤖
Created 2023-08-18
2,674 commits to main branch, last one 8 hours ago
1.1k
10.6k
apache-2.0
93
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Created 2023-05-04
1,249 commits to main branch, last one 5 days ago
1.0k
10.4k
apache-2.0
88
本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
Created 2023-05-23
898 commits to main branch, last one 3 days ago
635
10.0k
apache-2.0
56
Run any open-source LLMs, such as Llama, Gemma, as OpenAI compatible API endpoint in the cloud.
Created 2023-04-19
1,818 commits to main branch, last one a day ago
860
9.7k
apache-2.0
125
Official inference library for Mistral models
Created 2023-09-27
153 commits to main branch, last one 21 days ago

Trending repositories for topic llm-inference (view more)