Search Results - RepositoryStats

prometheus-eval prometheus-eval

49

792

apache-2.0

3

Evaluate your LLM's response with Prometheus and GPT4 💯

llm gpt4 vllm llmops python litellm evaluation llm-as-a-judge llm-as-evaluator

Created 2024-04-18

203 commits to main branch, last one about a month ago

agent-as-a-judge metauto-ai

16

178

mit

1

🤠 Agent-as-a-Judge and DevAI dataset

llms llm-as-a-judge agent-as-a-judge

Created 2024-10-16

20 commits to main branch, last one 5 days ago

xFinder IAAR-Shanghai

3

143

other

4

xFinder: Robust and Pinpoint Answer Extraction for Large Language Models

gpt llm phi qwen regex chatglm dataset xfinder benchmark evaluation judge-model reliability open-compass lm-evaluation llm-as-a-judge llm-as-evaluator reliable-evaluation key-answer-extraction large-language-models

Created 2024-05-19

33 commits to main branch, last one 9 days ago

CodeUltraFeedback martin-wey

5

65

mit

3

CodeUltraFeedback: aligning large language models to coding preferences

dpo alignment codal-bench llm-as-a-judge code-generation codeultrafeedback large-language-models

Created 2024-01-25

51 commits to main branch, last one 4 months ago

LLM-IR-Bias-Fairness-Survey KID-22

3

41

mit

2

This is the repo for the survey of Bias and Fairness in IR with LLMs.

ir llm bias llm4ir llm4rs chatgpt llm4rec fairness llm-as-a-judge llm-as-evaluator recommender-systems information-retrieval large-language-models

Created 2024-03-18

49 commits to main branch, last one 8 days ago

MJ-Bench MJ-Bench

4

37

mit

1

Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"

reward-models llm-as-a-judge llm-benchmarking multimodal-judge multimodal-foundation-model

Created 2024-06-11

25 commits to main branch, last one 3 months ago