1 result found Sort:

bentoml
OpenLLM bentoml
642
10.2k
apache-2.0
57
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
llm llama mlops llama2 llmops vicuna bentoml llm-ops mistral openllm llama3-1 llama3-2 fine-tuning llm-serving llm-inference llama3-2-vision model-inference open-source-llm
Created 2023-04-19
1,825 commits to main branch, last one 8 hours ago