Statistics for topic llm-inference

RepositoryStats tracks 584,796 Github repositories, of these 159 are tagged with the llm-inference topic. The most common primary language for repositories using this topic is Python (90). Other languages include: Jupyter Notebook (15),  C++ (13)

Stargazers over time for topic llm-inference

Most starred repositories for topic llm-inference (view more)

7.7k
70.7k
mit
646
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Created 2023-03-27
2,150 commits to main branch, last one 15 days ago
5.0k
34.5k
cc-by-4.0
403
A programming framework for agentic AI 🤖
Created 2023-08-18
2,742 commits to main branch, last one 8 hours ago
1.1k
10.8k
apache-2.0
95
本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
Created 2023-05-23
898 commits to main branch, last one 17 days ago
1.1k
10.7k
apache-2.0
94
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Created 2023-05-04
1,251 commits to main branch, last one 7 days ago
639
10.1k
apache-2.0
56
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
Created 2023-04-19
1,821 commits to main branch, last one 2 days ago
863
9.7k
apache-2.0
126
Official inference library for Mistral models
Created 2023-09-27
155 commits to main branch, last one 9 days ago

Trending repositories for topic llm-inference (view more)