48 results found Sort:

785
4.2k
apache-2.0
118
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on a...
Created 2020-07-21
12,120 commits to master branch, last one 6 months ago
校招、秋招、春招、实习好项目!带你从零实现一个高性能的深度学习推理库,支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step
Created 2022-11-21
793 commits to main branch, last one 26 days ago
Rule engine implementation in Golang
Created 2019-12-13
236 commits to master branch, last one 9 months ago
104
1.7k
apache-2.0
39
OneDiff: An out-of-the-box acceleration library for diffusion models.
Created 2022-09-21
583 commits to main branch, last one 13 days ago
284
1.2k
unknown
100
FeatherCNN is a high performance inference engine for convolutional neural networks.
Created 2018-04-27
19 commits to master branch, last one 5 years ago
Large-scale LLM inference engine
Created 2023-06-23
825 commits to main branch, last one 22 hours ago
139
999
apache-2.0
91
Paddle.js is a web project for Baidu PaddlePaddle, which is an open source deep learning framework running in the browser. Paddle.js can either load a pre-trained model, or transforming a model from p...
Created 2020-03-26
694 commits to release/v2.2.5 branch, last one 2 years ago
83
795
apache-2.0
29
Adlik: Toolkit for Accelerating Deep Learning Inference
Created 2019-09-23
406 commits to master branch, last one about a year ago
144
750
mit
26
🔥 (yolov3 yolov4 yolov5 unet ...)A mini pytorch inference framework which inspired from darknet.
Created 2020-07-05
611 commits to master branch, last one about a year ago
46
571
apache-2.0
11
Python Computer Vision & Video Analytics Framework With Batteries Included
Created 2022-05-07
799 commits to develop branch, last one 12 days ago
67
547
other
22
A library for high performance deep learning inference on NVIDIA GPUs.
Created 2021-03-11
103 commits to master branch, last one 2 years ago
135
532
apache-2.0
57
High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.
This repository has been archived (exclude archived)
Created 2018-05-18
788 commits to master branch, last one 5 years ago
276
531
lgpl-2.1
25
A common base representation of python source code for pylint and other projects
Created 2015-12-08
4,875 commits to main branch, last one a day ago
130
518
apache-2.0
30
A Machine Learning System for Data Enrichment.
Created 2018-11-09
266 commits to master branch, last one 5 years ago
80
497
bsd-3-clause
17
The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
Created 2023-12-20
52 commits to main branch, last one 8 days ago
A rule engine written in Ruby.
Created 2012-07-13
428 commits to master branch, last one 5 months ago
Julia package for automated Bayesian inference on a factor graph with reactive message passing
Created 2022-06-10
1,315 commits to main branch, last one 8 days ago
26
253
apache-2.0
19
docs for search system and ai infra
Created 2023-04-02
138 commits to master branch, last one 4 months ago
校招、秋招、春招、实习好项目,带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。
Created 2024-04-25
188 commits to main branch, last one 15 days ago
73
186
mit
25
MIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX also delivers a highly optimize...
Created 2018-12-20
983 commits to develop branch, last one a day ago
This is a repository for an object detection inference API using the Tensorflow framework.
Created 2019-12-11
415 commits to master branch, last one 2 years ago
35
169
apache-2.0
16
Ai edge toolbox,专门面向边端设备尤其是嵌入式RTOS平台,AI模型部署工具链,包括模型推理引擎和模型压缩工具
Created 2023-01-30
6 commits to master branch, last one 11 months ago
A quick view of high-performance convolution neural networks (CNNs) inference engines on mobile devices.
Created 2018-08-06
59 commits to master branch, last one 2 years ago
TinyTensor is a tool for running already trained NN (Neural Network) models to be able to use them for inference of various tasks such as image classification, semantic segmentation, etc.
Created 2023-03-02
157 commits to main branch, last one about a year ago
Large scale recommender system inference Microservices and APIs (Dubbo 、gRPC and REST ) with Golang.
Created 2023-09-05
171 commits to master branch, last one 6 months ago
Repository for OpenVINO's extra modules
Created 2020-11-02
891 commits to master branch, last one 20 days ago
7
104
apache-2.0
3
A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).
Created 2024-05-11
40 commits to master branch, last one 4 months ago
8
103
apache-2.0
7
PyTorch library for cost-effective, fast and easy serving of MoE models.
Created 2024-01-22
16 commits to main branch, last one 3 months ago
18
101
apache-2.0
6
DaisyKit is an easy AI toolkit with face mask detection, pose detection, background matting, barcode detection, face recognition and more. - with NCNN, OpenCV, Python wrappers
Created 2021-09-03
241 commits to master branch, last one about a year ago
Neural network inference template for real-time cricital audio environments - presented at ADC23
Created 2023-09-17
212 commits to main branch, last one about a month ago