2 results found Sort:

ray-project
ray-educational-materials ray-project
55
312
apache-2.0
10
This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.
llm ray ray-data ray-tune ray-serve ray-train llm-serving deep-learning generative-ai llm-inference ray-distributed distributed-machine-learning
This repository has been archived (exclude archived)
Created 2022-09-16
146 commits to main branch, last one 4 months ago
torchpipe
torchpipe torchpipe
12
135
apache-2.0
6
Boosting DL Service Throughput 1.5-4x by Ensemble Pipeline Serving with Concurrent CUDA Streams for PyTorch/LibTorch Frontend and TensorRT/CVCUDA, etc., Backends
ray serve cvcuda pytorch serving tensorrt inference ray-serve torch2trt deployment pipeline-parallelism triton-inference-server
Created 2023-10-24
147 commits to main branch, last one 22 days ago