Statistics for topic inference

RepositoryStats tracks 579,129 Github repositories, of these 298 are tagged with the inference topic. The most common primary language for repositories using this topic is Python (128). Other languages include: C++ (58),  Jupyter Notebook (27),  Rust (11),  TypeScript (11)

Stargazers over time for topic inference

Most starred repositories for topic inference (view more)

4.3k
38.8k
apache-2.0
384
Making large AI models cheaper, faster and more accessible
Created 2021-10-28
3,750 commits to main branch, last one 20 hours ago
3.6k
35.5k
mit
312
Port of OpenAI's Whisper model in C/C++
Created 2022-09-25
1,755 commits to master branch, last one 9 hours ago
4.1k
35.4k
apache-2.0
345
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Created 2020-01-23
2,551 commits to master branch, last one 6 hours ago
4.5k
29.7k
apache-2.0
242
A high-throughput and memory-efficient inference and serving engine for LLMs
Created 2023-02-09
3,290 commits to main branch, last one 7 hours ago
5.1k
27.5k
apache-2.0
514
Cross-platform, customizable ML solutions for live and streaming media.
Created 2019-06-13
4,276 commits to master branch, last one 11 hours ago
4.2k
20.4k
other
573
ncnn is a high-performance neural network inference framework optimized for the mobile platform
Created 2017-06-30
3,327 commits to master branch, last one 8 days ago

Trending repositories for topic inference (view more)