19 results found Sort:

roboflow
inference roboflow
137
1.4k
other
22
A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.
vit onnx docker jetson python yolo11 yolov5 yolov7 yolov8 tensorrt inference deployment hacktoberfest inference-api classification computer-vision inference-server machine-learning object-detection instance-segmentation
Created 2023-07-31
5,134 commits to main branch, last one a day ago
basetenlabs
truss basetenlabs
75
933
mit
19
The simplest way to serve AI/ML models in production
falcon whisper wizardlm packaging easy-to-use open-source inference-api model-serving inference-server machine-learning stable-diffusion artificial-intelligence
Created 2022-07-06
1,298 commits to main branch, last one a day ago
pipeless-ai
pipeless pipeless-ai
37
732
apache-2.0
6
An open-source computer vision framework to build and deploy apps in minutes
yolo cloud video ffmpeg python gstreamer inference multimedia perception deep-learning computer-vision inference-server machine-learning object-detection video-processing vision-framework stream-processing pipeline-framework artificial-intelligence multimedia-applications
Created 2023-07-21
664 commits to main branch, last one 7 months ago
underneathall
pinferencia underneathall
87
564
apache-2.0
41
Python + Inference - Model Deployment library in Python. Simplest model inference server ever.
ai nlp python predict pytorch serving inference tensorflow huggingface modelserver data-science paddlepaddle transformers deep-learning model-serving computer-vision inference-server machine-learning model-deployment artificial-intelligence
Created 2022-04-04
55 commits to main branch, last one 2 years ago
containers
ramalama containers
51
304
mit
17
The goal of RamaLama is to make working with AI boring.
ai llms vllm local podman llamacpp containers inference-server
Created 2024-07-24
977 commits to main branch, last one 2 days ago
BMW-InnovationLab
BMW-YOLOv4-Inference-API-GPU BMW-InnovationLab
69
281
bsd-3-clause
17
This is a repository for an nocode object detection inference API using the Yolov3 and Yolov4 Darknet framework.
api gpu yolo docker yolov3 yolov4 no-code rest-api yolo-gui inference dockerfile deeplearning deep-learning inference-gui bounding-boxes neural-network computer-vision alexeyab-darknet inference-server detection-inference-api
Created 2019-12-11
226 commits to master branch, last one 2 years ago
BMW-InnovationLab
BMW-YOLOv4-Inference-API-CPU BMW-InnovationLab
59
220
other
15
This is a repository for an nocode object detection inference API using the Yolov4 and Yolov3 Opencv.
api cpu docker opencv yolov3 yolov4 no-code rest-api inference deep-learning inference-gui bounding-boxes neural-network yolov4-darknet computer-vision inference-server object-detection cpu-inference-api deep-neural-networks detection-inference-api
Created 2019-12-11
158 commits to master branch, last one 2 years ago
containers
podman-desktop-extension-ai-lab containers
41
186
apache-2.0
20
Work with LLMs on a local environment using containers
ai llms local podman containers inference-server
Created 2023-12-19
1,408 commits to main branch, last one 2 days ago
BMW-InnovationLab
BMW-TensorFlow-Inference-API-CPU BMW-InnovationLab
48
185
apache-2.0
14
This is a repository for an object detection inference API using the Tensorflow framework.
api cpu docker rest-api docker-ce inference tensorflow predictions deeplearning docker-image deep-learning bounding-boxes computervision computer-vision docker-container inference-engine inference-server object-detection tensorflow-framework detection-inference-api
Created 2019-12-11
415 commits to master branch, last one 2 years ago
autodeployai
ai-serving autodeployai
31
150
apache-2.0
5
Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints
onnx pmml inference onnx-grpc onnx-rest pmml-grpc pmml-rest ai-serving pmml-model onnx-models onnx-realtime pmml-realtime onnx-inference pmml-inference pmml-deployment inference-server
Created 2020-04-16
48 commits to master branch, last one 2 months ago
vertexclique
orkhon vertexclique
5
146
mit
5
Orkhon: ML Inference Framework and Server Runtime
async python3 tensorflow multiprocessing data-parallelism inference-server machine-learning
Created 2019-05-18
102 commits to master branch, last one 3 years ago
kibae
onnxruntime-server kibae
7
131
mit
2
ONNX Runtime Server: The ONNX Runtime Server is a server that provides TCP and HTTP/HTTPS REST APIs for ONNX inference.
ai cuda onnx onnxruntime deep-learning nueral-networks inference-server machine-learning contributions-welcome
Created 2023-09-04
132 commits to main branch, last one 27 days ago
kf5i
k3ai kf5i
10
101
apache-2.0
9
K3ai is a lightweight, fully automated, AI infrastructure-in-a-box solution that allows anyone to experiment quickly with Kubeflow pipelines. K3ai is perfect for anything from Edge to laptops.
k3s edge kubeflow kubernetes datascience machinelearning inference-server kubeflow-pipelines artificial-intelligence
This repository has been archived (exclude archived)
Created 2020-09-30
90 commits to master branch, last one 3 years ago
notAI-tech
fastDeploy notAI-tech
17
96
mit
8
Deploy DL/ ML inference pipelines with minimal extra code.
docker falcon gevent python triton pytorch serving gunicorn websocket tf-serving torchserve http-server deep-learning model-serving triton-server streaming-audio inference-server model-deployment tensorflow-serving triton-inference-server
Created 2020-04-09
503 commits to master branch, last one about a month ago
RubixML
Server RubixML
12
61
mit
9
A standalone inference server for trained Rubix ML estimators.
api php php-ml json-api rest-api rubix-ml inference http-server microservice model-server rubix-server infrastructure inference-engine inference-server machine-learning model-deployment ml-infrastructure php-machine-learning
Created 2019-01-02
282 commits to master branch, last one 10 months ago
friendliai
friendli-client friendliai
8
42
apache-2.0
4
Friendli: the fastest serving engine for generative AI
ai ml gpt llm gpt3 llms mlops llama2 llmops llm-ops mistral serving inference llm-serving generative-ai llm-inference inference-engine inference-server stable-diffusion
Created 2023-07-20
65 commits to main branch, last one 2 months ago
curtisgray
wingman curtisgray
2
42
mit
3
Wingman is the fastest and easiest way to run Llama models on your PC or Mac.
ai gpu llm linux llama local macos openai chatbot chatgpt windows download llamacpp inference downloader gpu-monitoring gpu-acceleration inference-engine inference-server
Created 2023-10-05
360 commits to develop branch, last one 6 months ago
haicheviet
fullstack-machine-learning-inference haicheviet
12
30
unknown
3
Fullstack machine learning inference template
aws fastapi full-stack cloudformation inference-server machine-learning infrastructure-as-code machine-learning-template twitter-sentiment-analysis machine-learning-infrastructure
Created 2022-07-26
6 commits to master branch, last one about a year ago
tensorchord
inference-benchmark tensorchord
3
27
unknown
6
Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
llm whisper benchmark inference-server stable-diffusion
Created 2023-06-12
17 commits to main branch, last one about a year ago