1 result found Sort:

substratusai
kubeai substratusai
54
674
apache-2.0
12
AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports LLMs, embeddings, and speech-to-text.
ai k8s llm vllm ollama whisper autoscaler kubernetes openai-api vllm-operator faster-whisper ollama-operator inference-operator
Created 2023-10-21
241 commits to main branch, last one 10 days ago