Search Results - RepositoryStats

379

4.8k

mit

21

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command ...

ci llm rag cicd ci-cd llmops prompts testing llm-eval evaluation pentesting red-teaming llm-evaluation prompt-testing prompt-engineering evaluation-framework vulnerability-scanners llm-evaluation-framework

Created 2023-04-28

2,842 commits to main branch, last one 8 hours ago

deepeval confident-ai

298

3.7k

apache-2.0

21

The LLM Evaluation Framework

llm-evaluation evaluation-metrics evaluation-framework llm-evaluation-metrics llm-evaluation-framework

Created 2023-08-10

3,808 commits to main branch, last one a day ago

MixEval Psycoy

35

224

unknown

1

The official evaluation suite and dynamic data release for MixEval.

mixeval benchmark evaluation llm-inference llm-evaluation benchmark-mixture foundation-models benchmarking-suite evaluation-framework large-language-model large-language-models benchmarking-framework large-multimodal-models llm-evaluation-framework

Created 2024-06-01

120 commits to main branch, last one 13 days ago

parea-sdk-py parea-ai

6

74

apache-2.0

2

Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

llm llmops metrics llm-eval llm-tools generative-ai llm-evaluation good-first-issue llms-benchmarking prompt-engineering llm-evaluation-toolkit llm-evaluation-framework

Created 2023-07-24

1,067 commits to main branch, last one 2 months ago

KIEval zhuohaoyu

2

32

unknown

3

[ACL'24] A Knowledge-grounded Interactive Evaluation Framework for Large Language Models

llm acl2024 explainable-ai llm-evaluation machine-learning llm-evaluation-metrics llm-evaluation-toolkit llm-evaluation-framework

Created 2024-02-23

19 commits to master branch, last one 4 months ago