Search Results - RepositoryStats

230

3.4k

mit

18

Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with comman...

ci llm rag cicd ci-cd llmops prompts testing llm-eval evaluation llm-evaluation prompt-testing prompt-engineering evaluation-framework llm-evaluation-framework

Created 2023-04-28

1,361 commits to main branch, last one 20 hours ago

deepeval confident-ai

159

2.3k

apache-2.0

16

The LLM Evaluation Framework

llm-evaluation evaluation-metrics evaluation-framework llm-evaluation-metrics llm-evaluation-framework

Created 2023-08-10

3,019 commits to main branch, last one a day ago

MixEval Psycoy

19

152

unknown

1

The official evaluation suite and dynamic data release for MixEval.

mixeval benchmark evaluation llm-inference llm-evaluation benchmark-mixture foundation-models benchmarking-suite evaluation-framework large-language-model large-language-models benchmarking-framework large-multimodal-models llm-evaluation-framework

Created 2024-06-01

35 commits to main branch, last one 7 days ago

parea-sdk-py parea-ai

4

43

apache-2.0

2

Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

llm llmops metrics llm-eval llm-tools generative-ai llm-evaluation good-first-issue llms-benchmarking prompt-engineering llm-evaluation-toolkit llm-evaluation-framework

Created 2023-07-24

925 commits to main branch, last one 6 days ago