17 results found Sort:

roboflow
inference roboflow
78
1.1k
other
19
A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.
vit onnx docker jetson python server yolact yolov5 yolov7 yolov8 tensorrt inference deployment inference-api classification computer-vision inference-server machine-learning object-detection instance-segmentation
Created 2023-07-31
2,373 commits to main branch, last one 4 days ago
basetenlabs
truss basetenlabs
58
848
mit
11
The simplest way to serve AI/ML models in production
falcon whisper wizardlm packaging easy-to-use open-source inference-api model-serving inference-server machine-learning stable-diffusion artificial-intelligence
Created 2022-07-06
976 commits to main branch, last one 12 hours ago
pipeless-ai
pipeless pipeless-ai
31
664
apache-2.0
5
An open-source computer vision framework to build and deploy apps in minutes
yolo cloud video ffmpeg python gstreamer inference multimedia perception deep-learning computer-vision inference-server machine-learning object-detection video-processing vision-framework stream-processing pipeline-framework artificial-intelligence multimedia-applications
Created 2023-07-21
664 commits to main branch, last one 23 days ago
underneathall
pinferencia underneathall
85
558
apache-2.0
41
Python + Inference - Model Deployment library in Python. Simplest model inference server ever.
ai nlp python predict pytorch serving inference tensorflow huggingface modelserver data-science paddlepaddle transformers deep-learning model-serving computer-vision inference-server machine-learning model-deployment artificial-intelligence
Created 2022-04-04
55 commits to main branch, last one about a year ago
BMW-InnovationLab
BMW-YOLOv4-Inference-API-GPU BMW-InnovationLab
73
280
bsd-3-clause
18
This is a repository for an nocode object detection inference API using the Yolov3 and Yolov4 Darknet framework.
api gpu yolo docker yolov3 yolov4 no-code rest-api yolo-gui inference dockerfile deeplearning deep-learning inference-gui bounding-boxes neural-network computer-vision alexeyab-darknet inference-server detection-inference-api
Created 2019-12-11
226 commits to master branch, last one about a year ago
BMW-InnovationLab
BMW-YOLOv4-Inference-API-CPU BMW-InnovationLab
64
219
other
16
This is a repository for an nocode object detection inference API using the Yolov4 and Yolov3 Opencv.
api cpu docker opencv yolov3 yolov4 no-code rest-api inference deep-learning inference-gui bounding-boxes neural-network yolov4-darknet computer-vision inference-server object-detection cpu-inference-api deep-neural-networks detection-inference-api
Created 2019-12-11
158 commits to master branch, last one about a year ago
BMW-InnovationLab
BMW-TensorFlow-Inference-API-CPU BMW-InnovationLab
49
186
apache-2.0
15
This is a repository for an object detection inference API using the Tensorflow framework.
api cpu docker rest-api docker-ce inference tensorflow predictions deeplearning docker-image deep-learning bounding-boxes computervision computer-vision docker-container inference-engine inference-server object-detection tensorflow-framework detection-inference-api
Created 2019-12-11
415 commits to master branch, last one about a year ago
autodeployai
ai-serving autodeployai
31
145
apache-2.0
5
Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints
api grpc onnx pmml inference real-time ai-serving pmml-model onnx-models deep-learning inference-server machine-learning
Created 2020-04-16
39 commits to master branch, last one 8 months ago
vertexclique
orkhon vertexclique
5
145
mit
5
Orkhon: ML Inference Framework and Server Runtime
async python3 tensorflow multiprocessing data-parallelism inference-server machine-learning
Created 2019-05-18
102 commits to master branch, last one 3 years ago
containers
podman-desktop-extension-ai-lab containers
22
138
apache-2.0
20
Work with LLMs on a local environment using containers
ai llms local podman containers inference-server
Created 2023-12-19
648 commits to main branch, last one 24 hours ago
kf5i
k3ai kf5i
10
101
apache-2.0
9
K3ai is a lightweight, fully automated, AI infrastructure-in-a-box solution that allows anyone to experiment quickly with Kubeflow pipelines. K3ai is perfect for anything from Edge to laptops.
k3s edge kubeflow kubernetes datascience machinelearning inference-server kubeflow-pipelines artificial-intelligence
This repository has been archived (exclude archived)
Created 2020-09-30
90 commits to master branch, last one 2 years ago
kibae
onnxruntime-server kibae
5
97
mit
2
ONNX Runtime Server: The ONNX Runtime Server is a server that provides TCP and HTTP/HTTPS REST APIs for ONNX inference.
ai cuda onnx onnxruntime deep-learning nueral-networks inference-server machine-learning contributions-welcome
Created 2023-09-04
119 commits to main branch, last one 10 days ago
notAI-tech
fastDeploy notAI-tech
18
93
mit
8
Deploy DL/ ML inference pipelines with minimal extra code.
docker falcon gevent python triton pytorch serving gunicorn websocket tf-serving torchserve http-server deep-learning model-serving triton-server streaming-audio inference-server model-deployment tensorflow-serving triton-inference-server
Created 2020-04-09
458 commits to master branch, last one about a month ago
RubixML
Server RubixML
12
61
mit
8
A standalone inference server for trained Rubix ML estimators.
api php php-ml json-api rest-api rubix-ml inference http-server microservice model-server rubix-server infrastructure inference-engine inference-server machine-learning model-deployment ml-infrastructure php-machine-learning
Created 2019-01-02
282 commits to master branch, last one 3 months ago
friendliai
friendli-client friendliai
5
37
apache-2.0
3
Friendli: the fastest serving engine for generative AI
ai ml gpt llm gpt3 llms mlops llama2 llmops llm-ops mistral serving inference llm-serving generative-ai llm-inference inference-engine inference-server stable-diffusion
Created 2023-07-20
53 commits to main branch, last one 7 days ago
curtisgray
wingman curtisgray
1
37
mit
2
Wingman is the fastest and easiest way to run Llama models on your PC or Mac.
ai gpu llm linux llama local macos openai chatbot chatgpt windows download llamacpp inference downloader gpu-monitoring gpu-acceleration inference-engine inference-server
Created 2023-10-05
359 commits to develop branch, last one 2 days ago
tensorchord
inference-benchmark tensorchord
3
26
unknown
6
Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
llm whisper benchmark inference-server stable-diffusion
Created 2023-06-12
17 commits to main branch, last one 11 months ago