Challenge: Hallucination remains a critical challenge for multimodal large language models, undermining their reliability in real-world applications.
Approach: They propose a benchmark specifically designed for evaluating MLLMs’ capability in performing token-level hallucination detection (FHD) . they use curated training data to train a specialized model that significantly outperforms existing models.
Outcome: The proposed model outperforms existing models in the evaluation of 9 MLLMs and reaches an average F1IoU of 40.59%.

Similar Papers

Unified Hallucination Detection for Multimodal Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: despite significant strides in multimodal tasks, MLLMs are plagued by the critical issue of hallucination.
Approach: They propose a meta-evaluation benchmark to facilitate evaluation of advancements in hallucination detection methods.
Outcome: The proposed framework validates hallucinations robustly and provides strategic insights . MHaluBench is a meta-evaluation benchmark designed to facilitate evaluation .
HalluAudio: A Comprehensive Benchmark for Hallucination Detection in Large Audio-Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on hallucination focus on text or vision, while few audio-oriented studies are limited in scale, modality coverage, and diagnostic depth.
Approach: They propose a large-scale benchmark for evaluating hallucinations across speech, sound, and music.
Outcome: The proposed model improves hallucination rate, yes/no bias, error-type analysis, and refusal rate.
EGOILLUSION: Benchmarking Hallucinations in Egocentric Video Understanding (2025.emnlp-main)

Copied to clipboard

Challenge: Multimodal Large Language Models excel at visual perception and reasoning in third-person and egocentric videos, but are prone to hallucinations, generating coherent yet inaccurate responses.
Approach: They propose to use a benchmark to evaluate MLLM hallucinations in egocentric videos.
Outcome: EGOILLUSION comprises 1,400 videos paired with 8,000 human-annotated open and closed-ended questions designed to trigger hallucinations in both visual and auditory cues in egocentric videos.
Mitigating Hallucination in Multimodal Large Language Model via Hallucination-targeted Direct Preference Optimization (2025.findings-acl)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) are known to hallucinate, which limits their practical applications.
Approach: They propose a method that uses three types of preference pairs to target hallucinations from their diverse forms and causes.
Outcome: The proposed method surpasses most state-of-the-art methods and shows potential for further improvements.
Beyond Ranking: Fine-Grained Diagnostics and Self-Improvement for MLLMs (2026.acl-long)

Copied to clipboard

Challenge: Current paradigms rely on holistic scoring and static leaderboards to disentangle fine-grained competencies.
Approach: They propose a framework to shift the focus from ranking to fine-grained diagnosis.
Outcome: The proposed framework surpasses the strongest baseline by 7.92%.
DiaHalu: A Dialogue-level Hallucination Evaluation Benchmark for Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks for hallucination detection are intentionally generated by large language models (LLMs) however, many focus on factuality while ignoring faithfulness.
Approach: They propose a dialogue-level hallucination evaluation benchmark for large language models . they integrate the topic into prompts and facilitate a dialog between two LLMs .
Outcome: The proposed benchmark covers four common multi-turn dialogue domains and five hallucination subtypes, extended from factuality and faithfulness hallucines.
MM-SAP: A Comprehensive Benchmark for Assessing Self-Awareness of Multimodal Large Language Models in Perception (2024.acl-long)

Copied to clipboard

Challenge: Recent advances in multimodal large language models (MLLMs) have demonstrated exceptional capabilities in visual perception and understanding, but they also suffer from hallucinations, which limit their reliability as AI systems.
Approach: They propose a benchmark to evaluate self-awareness in perception for multimodal large language models (MLLMs) by integrating image information with knowledge quadrants, and propose MM-SAP to evaluate this capability.
Outcome: The proposed benchmark offers detailed analysis of MLLMs with self-awareness in perception.
RRHF-V: Ranking Responses to Mitigate Hallucinations in Multimodal Large Language Models with Human Feedback (2025.coling-main)

Copied to clipboard

Challenge: Existing methods to mitigate hallucinations generate erroneous or fabricated information.
Approach: They propose a rank-response-based model that annotates pair-reponses and trains alignment algorithms to improve the correspondence between images and text.
Outcome: The proposed model outperforms the DPO method and outperfies existing methods on two MLLMs of different sizes and four widely used benchmarks.
Visual Hallucinations of Multi-modal Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies find VH instances only in existing image datasets, which results in biased understanding of MLLMs’ performance under VH.
Approach: They propose a tool called VHTest to generate a diverse set of VH instances from existing image datasets and a text-to-image generative model to generate VH images based on the text descriptions.
Outcome: The proposed tool finds VH instances in existing image datasets and generates images based on the text descriptions.
When Models Lie, We Learn: Multilingual Span-Level Hallucination Detection with PsiloQA (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing hallucination detection benchmarks operate at the sequence level and are limited to English . Existing methods lacking fine-grained, multilingual supervision are limited in English based on the sequence .
Approach: They propose a large-scale, multilingual dataset annotated with span-level hallucinations across 14 languages.
Outcome: The proposed dataset annotated with span-level hallucinations across 14 languages is scalable and cost-efficient.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations