45 results found Sort:

769
4.1k
apache-2.0
114
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on a...
Created 2020-07-21
12,120 commits to master branch, last one 18 days ago
Rule engine implementation in Golang
Created 2019-12-13
236 commits to master branch, last one 4 months ago
带你从零实现一个高性能的深度学习推理库,支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step
Created 2022-11-21
756 commits to main branch, last one 18 hours ago
85
1.7k
unknown
14
Drop-in, local AI alternative to the OpenAI stack. Multi-engine (llama.cpp, TensorRT-LLM). Powers 👋 Jan
Created 2023-09-11
1,000 commits to dev branch, last one a day ago
79
1.3k
apache-2.0
38
OneDiff: An out-of-the-box acceleration library for diffusion models.
Created 2022-09-21
472 commits to main branch, last one a day ago
285
1.2k
unknown
101
FeatherCNN is a high performance inference engine for convolutional neural networks.
Created 2018-04-27
19 commits to master branch, last one 4 years ago
134
949
apache-2.0
92
Paddle.js is a web project for Baidu PaddlePaddle, which is an open source deep learning framework running in the browser. Paddle.js can either load a pre-trained model, or transforming a model from p...
Created 2020-03-26
694 commits to release/v2.2.5 branch, last one about a year ago
82
788
apache-2.0
29
Adlik: Toolkit for Accelerating Deep Learning Inference
Created 2019-09-23
406 commits to master branch, last one about a year ago
143
729
mit
26
🔥 (yolov3 yolov4 yolov5 unet ...)A mini pytorch inference framework which inspired from darknet.
Created 2020-07-05
611 commits to master branch, last one about a year ago
PygmalionAI's large-scale inference engine
Created 2023-06-23
632 commits to main branch, last one 15 days ago
67
546
other
22
A library for high performance deep learning inference on NVIDIA GPUs.
Created 2021-03-11
103 commits to master branch, last one 2 years ago
135
530
apache-2.0
57
High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.
This repository has been archived (exclude archived)
Created 2018-05-18
788 commits to master branch, last one 4 years ago
265
514
lgpl-2.1
25
A common base representation of python source code for pylint and other projects
Created 2015-12-08
4,697 commits to main branch, last one 11 days ago
129
512
apache-2.0
30
A Machine Learning System for Data Enrichment.
Created 2018-11-09
266 commits to master branch, last one 5 years ago
39
494
apache-2.0
11
Python Computer Vision & Video Analytics Framework With Batteries Included
Created 2022-05-07
700 commits to develop branch, last one 20 hours ago
A rule engine written in Ruby.
Created 2012-07-13
427 commits to master branch, last one 9 months ago
39
281
bsd-3-clause
11
The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
Created 2023-12-20
31 commits to main branch, last one 2 days ago
26
242
apache-2.0
19
docs for search system and ai infra
Created 2023-04-02
84 commits to master branch, last one about a year ago
This is a repository for an object detection inference API using the Tensorflow framework.
Created 2019-12-11
415 commits to master branch, last one about a year ago
72
184
mit
24
MIVisionX toolkit is a set of comprehensive computer vision and machine intelligence libraries, utilities, and applications bundled into a single toolkit. AMD MIVisionX also delivers a highly optimize...
Created 2018-12-20
919 commits to develop branch, last one 15 hours ago
32
153
apache-2.0
15
Ai edge toolbox,专门面向边端设备尤其是嵌入式RTOS平台,AI模型部署工具链,包括模型推理引擎和模型压缩工具
Created 2023-01-30
6 commits to master branch, last one 5 months ago
A quick view of high-performance convolution neural networks (CNNs) inference engines on mobile devices.
Created 2018-08-06
59 commits to master branch, last one about a year ago
TinyTensor is a tool for running already trained NN (Neural Network) models to be able to use them for inference of various tasks such as image classification, semantic segmentation, etc.
Created 2023-03-02
157 commits to main branch, last one 11 months ago
Large scale recommender system inference Microservices and APIs (Dubbo 、gRPC and REST ) with Golang.
Created 2023-09-05
171 commits to master branch, last one 11 days ago
Repository for OpenVINO's extra modules
Created 2020-11-02
885 commits to master branch, last one 4 days ago
17
96
apache-2.0
6
DaisyKit is an easy AI toolkit with face mask detection, pose detection, background matting, barcode detection, face recognition and more. - with NCNN, OpenCV, Python wrappers
Created 2021-09-03
241 commits to master branch, last one 7 months ago
Neural network inference template for real-time cricital audio environments - presented at ADC23
Created 2023-09-17
197 commits to main branch, last one about a month ago
Deep computer-vision algorithms for the Processing framework.
Created 2020-02-23
298 commits to master branch, last one about a year ago
32
75
apache-2.0
9
An optimized neural network operator library for chips base on Xuantie CPU.
Created 2021-10-18
25 commits to main branch, last one 2 months ago
Runs LLaMA with Extremely HIGH speed
Created 2023-11-07
159 commits to main branch, last one 6 months ago