4 results found Sort:

raga-ai-hub
RagaAI-Catalyst raga-ai-hub
3.8k
16.2k
apache-2.0
28
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal...
agents llmops agentneo agentic-ai llm-testing llm-tracing ai-agent-monitoring ai-evaluation-tools agentic-ai-development ai-application-debugging ai-performance-optimization ai-tool-interaction-monitoring
Created 2024-08-26
1,048 commits to main branch, last one 22 hours ago
JohnSnowLabs
langtest JohnSnowLabs
45
516
apache-2.0
8
Deliver safe & effective language models
llm nlp mlops llm-test ai-safety ml-safety ai-testing benchmarks ml-testing llm-testing ethics-in-ai responsible-ai trustworthy-ai llm-as-evaluator model-assessment benchmark-framework large-language-models llm-evaluation-toolkit artificial-intelligence
Created 2022-11-18
5,706 commits to main branch, last one about a month ago
LLAMATOR-Core
llamator LLAMATOR-Core
9
97
other
2
Framework for testing vulnerabilities of large language models (LLM).
ai llm nlp rag owasp attack python red-team jailbreak ai-security llm-testing red-teaming llm-security llm-read-team hallucinations misinformation rag-evaluation red-team-tools security-tools vulnerability-assessment
Created 2024-09-05
10 commits to release branch, last one 5 days ago
Addepto
contextcheck Addepto
8
64
mit
2
MIT-licensed Framework for LLMs, RAGs, Chatbots testing. Configurable via YAML and integrable into CI pipelines for automated testing.
ci llm rag ai-chat ai-testing llm-testing open-source prompt-test rag-testing testing-tools llm-evaluation ai-testing-tool chatbot-testing chatbot-framework testing-framework generative-ai-testing large-language-models summarization-testing llm-evaluation-framework
Created 2024-10-30
134 commits to main branch, last one 4 months ago