3 results found Sort:

bentoml
BentoML bentoml
766
6.8k
apache-2.0
74
The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
llm mlops llmops python multimodal llm-serving deep-learning generative-ai llm-inference model-serving ml-engineering machine-learning inference-platform model-inference-service
Created 2019-04-02
3,150 commits to main branch, last one 4 days ago
bentoml
CLIP-API-service bentoml
3
44
apache-2.0
5
CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search
clip mlops openai-clip cloud-native model-serving ai-applications model-inference model-inference-service
Created 2023-04-18
26 commits to main branch, last one 8 months ago
bentoml
transformers-nlp-service bentoml
3
41
apache-2.0
6
Online Inference API for NLP Transformer models - summarization, text classification, sentiment analysis and more
llm nlp mlops llmops transformer model-serving model-deployment online-inference nlp-machine-learning model-inference-service
Created 2023-04-18
22 commits to main branch, last one 7 months ago