6 results found Sort:

Arize-ai
phoenix Arize-ai
403
5.5k
other
37
AI Observability & Evaluation
llms evals agents llmops openai datasets llm-eval anthropic langchain llamaindex smolagents ai-monitoring aiengineering llm-evaluation ai-observability prompt-engineering
Created 2022-11-09
4,909 commits to main branch, last one 16 hours ago
lmnr-ai
lmnr lmnr-ai
113
1.9k
apache-2.0
11
Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.
ai ts rust aiops evals agents llmops analytics rust-lang evaluation monitoring typescript open-source self-hosted llm-workflow observability llm-evaluation developer-tools ai-observability llm-observability
Created 2024-08-29
540 commits to main branch, last one 19 hours ago
openlit
openlit openlit
141
1.4k
apache-2.0
14
Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, ...
llms otlp genai llmops openai python amd-gpu grafana metrics tracing langchain clickhouse nvidia-smi open-source observability opentelemetry gpu-monitoring monitoring-tool ai-observability distributed-tracing
Created 2024-01-23
487 commits to main branch, last one 7 hours ago
fiddler-labs
fiddler-auditor fiddler-labs
20
179
other
7
Fiddler Auditor is a tool to evaluate language models.
nlp llms langchain evaluation robustness generative-ai ai-observability
Created 2023-05-18
142 commits to main branch, last one about a year ago
radicalbit
radicalbit-ai-monitoring radicalbit
10
81
apache-2.0
5
A comprehensive solution for monitoring your AI models in production
ai data-drift monitoring data-science ai-monitoring observability ai-observability machine-learning ml-observability llm-observability artificial-intelligence machine-learning-engineering
Created 2024-06-19
230 commits to main branch, last one 2 months ago
Arize-ai
client_python Arize-ai
15
50
bsd-3-clause
15
A python library to send data to Arize AI!
ai-roi ai-monitoring ml-monitoring ai-observability drift-monitoring ml-observability model-monitoring model-explainability performance-monitoring data-quality-monitoring model-performance-management
Created 2020-03-05
217 commits to main branch, last one 9 days ago