9 results found Sort:

bentoml
OpenLLM bentoml
639
10.1k
apache-2.0
56
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
llm llama mlops llama2 llmops vicuna bentoml llm-ops mistral openllm llama3-1 llama3-2 fine-tuning llm-serving llm-inference llama3-2-vision model-inference open-source-llm
Created 2023-04-19
1,821 commits to main branch, last one 2 days ago
truefoundry
cognita truefoundry
274
3.3k
apache-2.0
33
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
ai llm rag data agent mlops llmops python llm-ops framework typescript application fine-tuning deep-learning generative-ai machine-learning model-deployment retrieval-augmented-generation
Created 2023-07-26
381 commits to main branch, last one 3 days ago
julep-ai
julep julep-ai
911
2.6k
apache-2.0
11
A new DSL and server for AI agents and multi-step tasks
ai llm agents python devfest llm-ops aiagents ai-agents ai-memory ai-platform hacktoberfest developer-tools hacktoberfest2024 ai-agents-framework
Created 2024-04-04
1,914 commits to dev branch, last one a day ago
lastmile-ai
aiconfig lastmile-ai
79
963
mit
12
AIConfig is a config-based framework to build generative AI applications.
ai llm llm-ops generative-ai developer-tools
Created 2023-09-01
1,953 commits to main branch, last one 6 months ago
EmbeddedLLM
JamAIBase EmbeddedLLM
17
426
apache-2.0
5
The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on...
ai llm rag baas agents python svelte chatbot chatgpt lancedb llm-ops llama3-1 workflow serverless spreadsheet orchestration ai-agents-framework backend-as-a-service intelligent-spreadsheet retrieval-augmented-generation
Created 2024-05-30
14 commits to main branch, last one a day ago
athina-ai
athina-evals athina-ai
13
221
unknown
5
Python SDK for running evaluations on LLM generated responses
llmops llm-ops llm-eval evaluation llm-evaluation evaluation-metrics evaluation-framework llm-evaluation-toolkit
Created 2023-11-22
570 commits to main branch, last one 5 days ago
astronomer
ask-astro astronomer
47
196
apache-2.0
10
An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer
llm airflow llm-ops astronomer
Created 2023-09-07
130 commits to main branch, last one 19 days ago
Trainy-ai
konduktor Trainy-ai
1
44
other
1
cluster/scheduler health monitoring for GPU jobs on k8s
ai ml gpu k8s llm llm-ops k8s-cluster ml-platform health-check hpc-clusters deep-learning job-scheduler observability gpu-monitoring metrics-gathering ml-infrastructure resource-management
Created 2024-05-07
110 commits to main branch, last one 5 days ago
friendliai
friendli-client friendliai
8
42
apache-2.0
4
Friendli: the fastest serving engine for generative AI
ai ml gpt llm gpt3 llms mlops llama2 llmops llm-ops mistral serving inference llm-serving generative-ai llm-inference inference-engine inference-server stable-diffusion
Created 2023-07-20
65 commits to main branch, last one about a month ago