14 results found Sort:

uptrain-ai
uptrain uptrain-ai
199
2.3k
apache-2.0
19
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform ro...
llmops llm-eval llm-test evaluation monitoring openai-evals llm-prompting autoevaluation experimentation machine-learning prompt-engineering jailbreak-detection root-cause-analysis hallucination-detection
Created 2022-11-07
770 commits to main branch, last one 9 months ago
KRLabsOrg
LettuceDetect KRLabsOrg
22
389
mit
7
LettuceDetect is a hallucination detection framework for RAG applications.
nlp bert python pytorch token-classification information-extraction hallucination-detection hallucination-evaluation
Created 2025-02-05
55 commits to main branch, last one 20 days ago
IAAR-Shanghai
UHGEval IAAR-Shanghai
17
162
apache-2.0
10
[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.
llm qwen ceval gpt-3 gpt-4 openai chatgpt dataset benchmark evaluation openai-api huggingface hallucination hallucinations large-language-models hallucination-detection hallucination-evaluation huggingface-transformers
Created 2023-11-06
167 commits to main branch, last one 5 months ago
NishilBalar
Awesome-LVLM-Hallucination NishilBalar
5
123
unknown
3
up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources
llm mlm lvlm mllm hallucination hallucination-survey large-language-models hallucination-research vision-language-models hallucination-benchmark hallucination-detection hallucination-evaluation hallucination-mitigation multimodal-language-model large-vision-language-models multimodal-large-language-models
Created 2024-03-15
55 commits to master branch, last one 19 days ago
voidism
Lookback-Lens voidism
7
120
unknown
2
Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"
factuality hallucinations text-generation large-language-models hallucination-detection
Created 2024-07-08
7 commits to main branch, last one 8 months ago
nikolamilosevic86
verifAI nikolamilosevic86
4
60
agpl-3.0
3
VerifAI initiative to build open-source easy-to-deploy generative question-answering engine that can reference and verify answers for correctness (using posteriori model)
llm nli nlp qlora bioasq openai pubmed qdrant medline scifact mistral-7b opensearch verification deep-learning generative-ai machine-learning generative-ai-search nlp-machine-learning hallucination-detection natural-language-processing
Created 2023-05-23
325 commits to main branch, last one about a month ago
OpenKG-ORG
EasyDetect OpenKG-ORG
4
58
apache-2.0
4
An Easy-to-use Hallucination Detection Framework for LLMs.
aigc easydetect generation genrative-ai hallucinations knowledge-graph large-language-models hallucination-detection natural-language-processing multimodal-large-language-models
Created 2023-12-31
56 commits to main branch, last one about a year ago
deshwalmahesh
PHUDGE deshwalmahesh
7
49
unknown
1
Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute, relative and much more. It contains a list of all the availab...
ai ml llm nlp sota judge phi-3 pytorch evaluation finetuning hallucination custom-dataset llm-evaluation feedback-collection hallucination-detection
Created 2024-05-11
30 commits to main branch, last one 9 months ago
Alsace08
Chain-of-Embedding Alsace08
4
44
apache-2.0
1
[ICLR 2025] Code and Data Repo for Paper "Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation"
iclr2025 trustworthy-ai self-evaluation interpretability large-language-models hallucination-detection
Created 2024-12-09
7 commits to master branch, last one 4 months ago
open-compass
ANAH open-compass
4
43
apache-2.0
2
[ACL 2024] ANAH & [NeurIPS 2024] ANAH-v2 & [ICLR 2025] Mask-DPO
acl gpt iclr llms neurips alignment hallucination-detection hallucination-mitigation
Created 2024-04-09
24 commits to main branch, last one 23 days ago
Ruiyang-061X
VL-Uncertainty Ruiyang-061X
2
32
unknown
2
🔎Official code for our paper: "VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimation".
multi-modal uncertainty hallucination vision-language uncertainty-analysis vision-language-model uncertainty-estimation hallucination-detection hallucination-evaluation uncertainty-quantification large-vision-language-model multi-modal-large-language-model
Created 2024-11-07
8 commits to main branch, last one about a month ago
zjunlp
EasyDetect zjunlp
2
30
apache-2.0
4
[ACL 2024] An Easy-to-use Hallucination Detection Framework for LLMs.
aigc knowlm easydetect generation multimodal generative-ai hallucination model-editing knowledge-graph knowledge-editing large-language-models artificial-intelligence hallucination-detection natural-language-processing multimodal-large-language-models
Created 2024-04-20
41 commits to main branch, last one 2 months ago
oumi-ai
halloumi-demo oumi-ai
1
30
apache-2.0
2
Try out HallOumi, a state-of-the-art claim verification model in a simple UI!
large-language-models hallucination-detection
Created 2025-03-19
26 commits to main branch, last one 24 days ago
patrick-tssn
VideoHallucer patrick-tssn
0
28
mit
4
VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
video-hallucination video-language-model hallucination-detection multimodal-large-language-models
Created 2024-04-07
54 commits to main branch, last one 25 days ago