10 results found Sort:

bentoml
OpenLLM bentoml
652
10.3k
apache-2.0
56
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
llm llama mlops llama2 llmops vicuna bentoml llm-ops mistral openllm llama3-1 llama3-2 fine-tuning llm-serving llm-inference llama3-2-vision model-inference open-source-llm
Created 2023-04-19
1,833 commits to main branch, last one 2 days ago
julep-ai
julep julep-ai
905
4.4k
apache-2.0
13
A new DSL and server for AI agents and multi-step tasks
ai llm agents python devfest llm-ops aiagents ai-agents ai-memory ai-platform hacktoberfest developer-tools hacktoberfest2024 ai-agents-framework
Created 2024-04-04
2,167 commits to dev branch, last one 2 days ago
truefoundry
cognita truefoundry
282
3.4k
apache-2.0
33
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
ai llm rag data agent mlops llmops python llm-ops framework typescript application fine-tuning deep-learning generative-ai machine-learning model-deployment retrieval-augmented-generation
Created 2023-07-26
394 commits to main branch, last one 12 days ago
Marker-Inc-Korea
AutoRAG Marker-Inc-Korea
228
3.0k
apache-2.0
23
AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
qa llm ops rag automl python llm-ops analysis pipeline embeddings evaluation open-source benchmarking optimization llm-evaluation rag-evaluation document-parser retrieval-augmented-generation
Created 2024-01-10
837 commits to main branch, last one 2 days ago
lastmile-ai
aiconfig lastmile-ai
81
970
mit
13
AIConfig is a config-based framework to build generative AI applications.
ai llm llm-ops generative-ai developer-tools
Created 2023-09-01
1,953 commits to main branch, last one 7 months ago
EmbeddedLLM
JamAIBase EmbeddedLLM
19
594
apache-2.0
6
The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on...
ai llm rag baas agents python svelte chatbot chatgpt lancedb llm-ops llama3-1 workflow serverless spreadsheet orchestration ai-agents-framework backend-as-a-service intelligent-spreadsheet retrieval-augmented-generation
Created 2024-05-30
20 commits to main branch, last one 22 days ago
athina-ai
athina-evals athina-ai
14
242
unknown
5
Python SDK for running evaluations on LLM generated responses
llmops llm-ops llm-eval evaluation llm-evaluation evaluation-metrics evaluation-framework llm-evaluation-toolkit
Created 2023-11-22
639 commits to main branch, last one 3 days ago
astronomer
ask-astro astronomer
49
207
apache-2.0
10
An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
llm airflow llm-ops astronomer
Created 2023-09-07
131 commits to main branch, last one 25 days ago
Trainy-ai
konduktor Trainy-ai
1
46
other
1
cluster/scheduler health monitoring for GPU jobs on k8s
ai ml gpu k8s llm llm-ops k8s-cluster ml-platform health-check hpc-clusters deep-learning job-scheduler observability gpu-monitoring metrics-gathering ml-infrastructure resource-management
Created 2024-05-07
112 commits to main branch, last one 9 days ago
friendliai
friendli-client friendliai
8
42
apache-2.0
4
Friendli: the fastest serving engine for generative AI
ai ml gpt llm gpt3 llms mlops llama2 llmops llm-ops mistral serving inference llm-serving generative-ai llm-inference inference-engine inference-server stable-diffusion
Created 2023-07-20
65 commits to main branch, last one 2 months ago