1 result found Sort:

torchpipe
torchpipe torchpipe
12
135
apache-2.0
6
Boosting DL Service Throughput 1.5-4x by Ensemble Pipeline Serving with Concurrent CUDA Streams for PyTorch/LibTorch Frontend and TensorRT/CVCUDA, etc., Backends
ray serve cvcuda pytorch serving tensorrt inference ray-serve torch2trt deployment pipeline-parallelism triton-inference-server
Created 2023-10-24
147 commits to main branch, last one 22 days ago