5 results found Sort:

uptrain-ai
uptrain uptrain-ai
190
2.2k
apache-2.0
20
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform ro...
llmops llm-eval llm-test evaluation monitoring openai-evals llm-prompting autoevaluation experimentation machine-learning prompt-engineering jailbreak-detection root-cause-analysis hallucination-detection
Created 2022-11-07
770 commits to main branch, last one 2 months ago
IAAR-Shanghai
UHGEval IAAR-Shanghai
17
177
apache-2.0
11
[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA
llm qwen gpt-3 gpt-4 openai chatglm chatgpt dataset benchmark evaluation openai-api huggingface hallucination hallucinations large-language-models hallucination-detection hallucination-evaluation huggingface-transformers
Created 2023-11-06
153 commits to main branch, last one 4 days ago
voidism
Lookback-Lens voidism
4
96
unknown
3
Official implementation for the paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"
factuality hallucinations text-generation large-language-models hallucination-detection
Created 2024-07-08
7 commits to main branch, last one about a month ago
OpenKG-ORG
EasyDetect OpenKG-ORG
3
49
apache-2.0
4
An Easy-to-use Hallucination Detection Framework for LLMs.
aigc easydetect generation genrative-ai hallucinations knowledge-graph large-language-models hallucination-detection natural-language-processing multimodal-large-language-models
Created 2023-12-31
56 commits to main branch, last one 5 months ago
deshwalmahesh
PHUDGE deshwalmahesh
7
48
unknown
1
Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute, relative and much more. It contains a list of all the availab...
ai ml llm nlp sota judge phi-3 pytorch evaluation finetuning hallucination custom-dataset llm-evaluation feedback-collection hallucination-detection
Created 2024-05-11
30 commits to main branch, last one 2 months ago