9 results found Sort:

langfuse
langfuse langfuse
927
10.1k
other
31
🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
llm llmops openai autogen analytics langchain evaluation monitoring playground llama-index open-source self-hosted ycombinator observability llm-evaluation llm-observability prompt-management prompt-engineering large-language-models
Created 2023-05-18
3,936 commits to main branch, last one 17 hours ago
comet-ml
opik comet-ml
437
6.2k
apache-2.0
61
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
llm llmops openai langchain playground llama-index open-source llm-evaluation llm-observability prompt-engineering
Created 2023-05-10
1,414 commits to main branch, last one 2 days ago
Helicone
helicone Helicone
355
3.6k
apache-2.0
20
🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
gpt llm llmops openai llm-cost analytics langchain evaluation monitoring playground llama-index open-source ycombinator llm-evaluation agent-monitoring llm-observability prompt-management prompt-engineering large-language-models
Created 2023-01-31
3,634 commits to main branch, last one a day ago
Agenta-AI
agenta Agenta-AI
284
2.3k
mit
25
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.
llm-tools llm-platform llm-framework llm-as-a-judge llm-evaluation llm-monitoring llm-playground rag-evaluation llmops-platform llm-observability prompt-management prompt-engineering
Created 2023-04-26
12,050 commits to main branch, last one 9 days ago
lmnr-ai
lmnr lmnr-ai
105
1.8k
apache-2.0
11
Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.
ai rag aiops evals agents llmops analytics rust-lang evaluation monitoring open-source self-hosted llm-workflow observability llm-evaluation developer-tools ai-observability pipeline-builder llm-observability
Created 2024-08-29
500 commits to main branch, last one 2 days ago
palico-ai
palico-ai palico-ai
26
338
mit
3
Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework
ai llm rag docker nodejs openai autogen portkey anthropic langchain llm-agent full-stack javascript llamaindex typescript langchain-js llm-framework llm-evaluation llm-observability
Created 2024-03-12
419 commits to main branch, last one 4 months ago
langfuse
oss-llmops-stack langfuse
2
92
mit
7
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability,...
llm llmops gateway ai-gateway monitoring llm-gateway open-source self-hosted ycombinator openai-proxy llm-evaluation llm-observability prompt-management
Created 2025-02-08
36 commits to main branch, last one about a month ago
radicalbit
radicalbit-ai-monitoring radicalbit
11
81
apache-2.0
5
A comprehensive solution for monitoring your AI models in production
ai data-drift monitoring data-science ai-monitoring observability ai-observability machine-learning ml-observability llm-observability artificial-intelligence machine-learning-engineering
Created 2024-06-19
230 commits to main branch, last one about a month ago
myscale
myscale-telemetry myscale
7
51
mit
3
Open-source observability for your LLM application.
python callback langchain monitoring llm-observability
Created 2024-05-21
39 commits to main branch, last one 3 months ago