1 result found Sort:

substratusai
kubeai substratusai
67
816
apache-2.0
11
AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.
ai k8s llm vllm ollama whisper autoscaler kubernetes openai-api vllm-operator faster-whisper ollama-operator inference-operator
Created 2023-10-21
276 commits to main branch, last one 3 days ago