6 results found Sort:

AgentOps-AI
agentops AgentOps-AI
235
2.4k
mit
27
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen
ai llm groq agent evals crewai ollama openai autogen mistral agentops anthropic langchain cost-estimation evaluation-metrics
Created 2023-08-15
555 commits to main branch, last one 18 hours ago
lmnr-ai
lmnr lmnr-ai
70
1.4k
apache-2.0
5
Laminar - open-source all-in-one platform for engineering AI products. Crate data flywheel for you AI app. Traces, Evals, Datasets, Labels. YC S24.
ai rag aiops evals agents llmops analytics rust-lang evaluation monitoring open-source self-hosted llm-workflow observability llm-evaluation developer-tools ai-observability pipeline-builder llm-observability
Created 2024-08-29
257 commits to main branch, last one 12 hours ago
superlinear-ai
raglite superlinear-ai
45
604
mpl-2.0
4
🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with PostgreSQL or SQLite
llm pdf rag evals sqlite colbert chainlit markdown pgvector postgres reranker tsvector reranking postgresql hybrid-search late-chunking query-adapter vector-search late-interaction retrieval-augmented-generation
Created 2024-06-10
49 commits to main branch, last one 3 days ago
mattpocock
evalite mattpocock
5
252
unknown
14
Test your LLM-powered apps with TypeScript. No API key required.
ai evals typescript
Created 2024-11-12
298 commits to main branch, last one 3 days ago
METR
vivaria METR
22
72
mit
4
Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
ai evals elicitation ai-evaluation
Created 2024-08-08
426 commits to main branch, last one 16 hours ago
AIAnytime
rag-evaluator AIAnytime
15
26
mit
2
A library for evaluating Retrieval-Augmented Generation (RAG) systems (The traditional ways).
rag eval evals
Created 2024-05-21
31 commits to main branch, last one 4 months ago