7 results found Sort:

Agenta-AI
agenta Agenta-AI
215
1.6k
mit
22
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.
llm-tools llm-platform llm-framework llm-as-a-judge llm-evaluation llm-monitoring llm-playground rag-evaluation llmops-platform llm-observability prompt-management prompt-engineering
Created 2023-04-26
10,700 commits to main branch, last one 2 days ago
prometheus-eval
prometheus-eval prometheus-eval
49
823
apache-2.0
3
Evaluate your LLM's response with Prometheus and GPT4 💯
llm gpt4 vllm llmops python litellm evaluation llm-as-a-judge llm-as-evaluator
Created 2024-04-18
204 commits to main branch, last one 22 days ago
metauto-ai
agent-as-a-judge metauto-ai
33
292
mit
3
🤠 Agent-as-a-Judge and DevAI dataset
llms llm-as-a-judge agent-as-a-judge
Created 2024-10-16
20 commits to main branch, last one about a month ago
IAAR-Shanghai
xFinder IAAR-Shanghai
3
154
other
4
xFinder: Robust and Pinpoint Answer Extraction for Large Language Models
gpt llm phi qwen regex chatglm dataset xfinder benchmark evaluation judge-model reliability open-compass lm-evaluation llm-as-a-judge llm-as-evaluator reliable-evaluation key-answer-extraction large-language-models
Created 2024-05-19
33 commits to main branch, last one about a month ago
martin-wey
CodeUltraFeedback martin-wey
5
67
mit
3
CodeUltraFeedback: aligning large language models to coding preferences
dpo alignment codal-bench llm-as-a-judge code-generation codeultrafeedback large-language-models
Created 2024-01-25
51 commits to main branch, last one 5 months ago
KID-22
LLM-IR-Bias-Fairness-Survey KID-22
3
44
mit
2
This is the repo for the survey of Bias and Fairness in IR with LLMs.
ir llm bias llm4ir llm4rs chatgpt llm4rec fairness llm-as-a-judge llm-as-evaluator recommender-systems information-retrieval large-language-models
Created 2024-03-18
49 commits to main branch, last one about a month ago
MJ-Bench
MJ-Bench MJ-Bench
5
40
mit
1
Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"
reward-models llm-as-a-judge llm-benchmarking multimodal-judge multimodal-foundation-model
Created 2024-06-11
29 commits to main branch, last one about a month ago