7 results found Sort:

langfuse
langfuse langfuse
646
6.9k
other
24
🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
gpt llm llmops openai analytics langchain evaluation monitoring playground llama-index open-source self-hosted ycombinator hacktoberfest observability llm-evaluation llm-observability prompt-management prompt-engineering large-language-models
Created 2023-05-18
3,133 commits to main branch, last one 7 hours ago
Helicone
helicone Helicone
242
2.1k
apache-2.0
9
🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, An...
gpt llm llmops openai llm-cost analytics langchain evaluation monitoring playground llama-index open-source ycombinator llm-evaluation agent-monitoring llm-observability prompt-management prompt-engineering large-language-models
Created 2023-01-31
2,987 commits to main branch, last one 18 hours ago
Agenta-AI
agenta Agenta-AI
203
1.5k
mit
20
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.
llm-tools llm-platform llm-framework llm-as-a-judge llm-evaluation llm-monitoring llm-playground rag-evaluation llmops-platform llm-observability prompt-management prompt-engineering
Created 2023-04-26
10,508 commits to main branch, last one 8 hours ago
lmnr-ai
lmnr lmnr-ai
60
1.2k
apache-2.0
5
Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.
ai rag aiops evals agents llmops analytics rust-lang evaluation monitoring open-source self-hosted llm-workflow observability llm-evaluation developer-tools ai-observability pipeline-builder llm-observability
Created 2024-08-29
228 commits to main branch, last one 11 hours ago
relic-dev
relic relic-dev
26
334
mit
3
Build, Improve Performance, and Productionize your LLM Application with an Integrated Framework
ai llm rag docker nodejs openai autogen portkey anthropic langchain llm-agent full-stack javascript llamaindex typescript langchain-js llm-framework llm-evaluation llm-observability
Created 2024-03-12
419 commits to main branch, last one 6 days ago
radicalbit
radicalbit-ai-monitoring radicalbit
7
71
apache-2.0
6
A comprehensive solution for monitoring your AI models in production
ai data-drift monitoring data-science ai-monitoring observability ai-observability machine-learning ml-observability llm-observability artificial-intelligence machine-learning-engineering
Created 2024-06-19
199 commits to main branch, last one 5 days ago
myscale
myscale-telemetry myscale
2
46
mit
5
Open-source observability for your LLM application.
python callback langchain monitoring llm-observability
Created 2024-05-21
38 commits to main branch, last one about a month ago