18 results found Sort:

627
2.7k
apache-2.0
62
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
Created 2023-10-19
136 commits to main branch, last one 14 hours ago
316
1.5k
mit
17
Add bisenetv2. My implementation of BiSeNet
Created 2018-11-29
63 commits to master branch, last one about a month ago
This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
Created 2020-08-10
100 commits to master branch, last one 2 years ago
OpenAI compatible API for TensorRT LLM triton backend
Created 2023-11-06
33 commits to main branch, last one 6 months ago
13
152
apache-2.0
9
【深度学习模型部署框架】支持tf/torch/trt/trtllm/vllm以及更多nn框架,支持dynamic batching、streaming模式,支持python/c++双语言,可限制,可拓展,高性能。帮助用户快速地将模型部署到线上,并通过http/rpc接口方式提供服务。
Created 2024-07-04
60 commits to master branch, last one 20 days ago
13
151
apache-2.0
6
Serving Inside Pytorch
Created 2023-10-24
345 commits to v0 branch, last one 6 days ago
40
141
apache-2.0
11
ClearML - Model-Serving Orchestration and Repository Solution
Created 2021-04-12
143 commits to main branch, last one 16 days ago
The Triton backend for the ONNX Runtime.
Created 2020-08-26
134 commits to main branch, last one a day ago
Deploy stable diffusion model with onnx/tenorrt + tritonserver
Created 2022-08-31
14 commits to master branch, last one 2 years ago
NVIDIA-accelerated DNN model inference ROS 2 packages using NVIDIA Triton/TensorRT for both Jetson and x86_64 with CUDA-capable GPU
Created 2021-10-13
42 commits to main branch, last one about a month ago
Анализ трафика на круговом движении с использованием компьютерного зрения
Created 2024-02-16
80 commits to main branch, last one about a month ago
Compare multiple optimization methods on triton to imporve model service performance
Created 2022-10-30
8 commits to main branch, last one about a year ago
Build Recommender System with PyTorch + Redis + Elasticsearch + Feast + Triton + Flask. Vector Recall, DeepFM Ranking and Web Application.
Created 2023-08-05
7 commits to master branch, last one about a year ago
Diffusion Model for Voice Conversion
Created 2023-03-10
53 commits to main branch, last one 10 months ago
1
44
bsd-3-clause
1
Tiny configuration for Triton Inference Server
Created 2022-05-26
59 commits to main branch, last one 19 days ago
Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NVIDIA-docker/ minIO/ Supervisord on AGX or PC from scratch.
Created 2020-02-27
79 commits to master branch, last one about a year ago
Provides an ensemble model to deploy a YoloV8 ONNX model to Triton
Created 2023-03-08
6 commits to main branch, last one about a year ago