3 results found Sort:

bentoml
OpenLLM bentoml
575
9.0k
apache-2.0
52
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
ai ml llm mpt llama mlops falcon llama2 llmops vicuna bentoml llm-ops mistral openllm stablelm fine-tuning llm-serving llm-inference model-inference open-source-llm
Created 2023-04-19
1,521 commits to main branch, last one a day ago
bentoml
CLIP-API-service bentoml
3
40
apache-2.0
5
CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search
clip mlops openai-clip cloud-native model-serving ai-applications model-inference model-inference-service
Created 2023-04-18
26 commits to main branch, last one 7 months ago
wangxb96
Awesome-AI-on-the-Edge wangxb96
2
40
mit
2
Resources of our survey paper "Enabling AI on Edges: Techniques, Applications and Challenges"
edge-ai tiny-ml awesome-list model-design deep-learning edge-computing model-inference machine-learning model-deployment model-compression data-preprocessing model-acceleration efficient-algorithm
Created 2023-01-19
119 commits to main branch, last one 14 days ago