1 result found Sort:

InftyAI
llmaz InftyAI
10
35
apache-2.0
4
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
llm helm vllm sglang llamacpp kubernetes modelscope huggingface llm-inference text-generation-inference
Created 2023-11-20
260 commits to main branch, last one 5 days ago