7 results found Sort:

bentoml
OpenLLM bentoml
575
9.0k
apache-2.0
52
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
ai ml llm mpt llama mlops falcon llama2 llmops vicuna bentoml llm-ops mistral openllm stablelm fine-tuning llm-serving llm-inference model-inference open-source-llm
Created 2023-04-19
1,521 commits to main branch, last one a day ago
truefoundry
cognita truefoundry
168
2.2k
apache-2.0
28
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
ai llm rag data agent mlops llmops python llm-ops framework typescript application fine-tuning deep-learning generative-ai machine-learning model-deployment retrieval-augmented-generation
Created 2023-07-26
114 commits to main branch, last one a day ago
lastmile-ai
aiconfig lastmile-ai
63
871
mit
10
AIConfig is a config-based framework to build generative AI applications.
ai llm llm-ops generative-ai developer-tools
Created 2023-09-01
1,953 commits to main branch, last one 10 days ago
julep-ai
julep julep-ai
6
274
apache-2.0
3
Open-source alternative to Assistant's API with memory, RAG, tools and tasks. ~ Supabase for building AI agents.
ai llm agents python llm-ops ai-agents ai-memory ai-platform developer-tools ai-agents-framework
Created 2024-04-04
1,287 commits to dev branch, last one 15 hours ago
astronomer
ask-astro astronomer
37
160
apache-2.0
10
An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
llm airflow llm-ops astronomer
Created 2023-09-07
125 commits to main branch, last one 2 days ago
athina-ai
athina-evals athina-ai
11
141
unknown
5
Python SDK for running evaluations on LLM generated responses
llmops llm-ops llm-eval evaluation llm-evaluation evaluation-metrics evaluation-framework llm-evaluation-toolkit
Created 2023-11-22
377 commits to main branch, last one a day ago
friendliai
friendli-client friendliai
5
37
apache-2.0
3
Friendli: the fastest serving engine for generative AI
ai ml gpt llm gpt3 llms mlops llama2 llmops llm-ops mistral serving inference llm-serving generative-ai llm-inference inference-engine inference-server stable-diffusion
Created 2023-07-20
53 commits to main branch, last one 7 days ago