Challenge: Multimodal large language models are increasingly deployed in open-ended, real-world environments where inputs are messy, underspecified, and not always trustworthy.
Approach: They evaluate multimodal large language models in real-world environments where inputs are messy, underspecified, and not always trustworthy.
Outcome: The proposed models fail to detect hidden issues even when they possess the necessary perceptual and reasoning skills.

Similar Papers

Exploring Response Uncertainty in MLLMs: An Empirical Evaluation under Misleading Scenarios (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies have focused mainly on visual–textual misalignment, leaving largely unexplored the MLLMs’ ability to preserve an original correct answer when confronted with misleading information.
Approach: They propose a two-stage evaluation pipeline to quantify the response uncertainty phenomenon by eliciting each model’s original response on unperturbed inputs and injecting explicit (false-answer hints) and implicit (contextual contradictions) misleading instructions.
Outcome: The proposed model overturns a correct answer in 65% of cases after receiving a single deceptive cue.
Hidden in Plain Sight: Evaluation of the Deception Detection Capabilities of LLMs in Multimodal Settings (2025.acl-long)

Copied to clipboard

Challenge: Detecting deception in an increasingly digital world is a critical and challenging task.
Approach: They evaluate the performance of both open-source and proprietary LLMs on three datasets . they find that fine-tuned LLM achieve state-of-the-art performance on textual deception detection .
Outcome: The proposed models achieve state-of-the-art on textual deception detection, whereas LMMs struggle to fully leverage multimodal cues.
Exploring and Evaluating Multimodal Knowledge Reasoning Consistency of Multimodal Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: MLLMs have achieved significant breakthroughs in understanding across text and vision, but current models still face inconsistencies in reasoning outcomes.
Approach: They propose to evaluate multimodal large language models using a multimodal knowledge reasoning dataset to examine the extent of consistency degradation.
Outcome: The proposed evaluation tasks show that MLLMs are inefficient at integrating knowledge across modalities .
When Seeing Is not Enough: Revealing the Limits of Active Reasoning in MLLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluations of multimodal large language models focus on passive inference, where seeing is not enough.
Approach: They propose a benchmark to evaluate active reasoning in multimodal large language models . they propose to acquire missing evidence and iteratively refine decisions under incomplete information .
Outcome: The proposed model performs better on active reasoning than on passive inference settings.
Can’t See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs (2025.acl-long)

Copied to clipboard

Challenge: Multimodal Large Language Models (MLLMs) have expanded the capabilities of traditional language models by enabling interaction through both text and images.
Approach: They propose a multimodal safety awareness benchmark to evaluate MLLMs across 29 safety scenarios with 1,500 carefully curated image-prompt pairs.
Outcome: The proposed model is able to identify unsafe content and avoid over-sensitivity that can hinder helpfulness.
Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing Multimodal Large Language Models (MLLMs) are predominantly trained on consistent visual-textual inputs, leaving open the question of whether they can handle semantic mismatches in layout-rich content.
Approach: They propose to use multimodal inconsistency reasoning to assess MLLMs' ability to reason about semantic mismatches in webpages, presentation slides, and posters.
Outcome: The proposed model outperforms open-source models in detecting inconsistencies in webpages, presentation slides, and posters while remaining vulnerable to inconsistent errors.
Quantifying and Mitigating Unimodal Biases in Multimodal Large Language Models: A Causal Perspective (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in Large Language Models have facilitated the development of Multimodal LLMs.
Approach: They propose a causal framework to interpret unimodal biases in visual question answering problems and a framework to integrate information from different modalities and mitigate biase.
Outcome: The proposed framework analyzes visual question answering (VQA) problems to assess their impact on predictions.
Insight Over Sight: Exploring the Vision-Knowledge Conflicts in Multimodal LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to mitigating vision-knowledge conflict in Large Language Models (MLLMs) are not effective and can be further scaled.
Approach: They propose a framework to generate inputs to simulate and evaluate vision-knowledge conflict in Multimodal Large Language Models (MLLMs) using original images and 1,122 high-quality question-answer pairs, they propose 'a diagnostic benchmark'
Outcome: The proposed framework, benchmark, and analysis contribute to the understanding and mitigation of vision-knowledge conflicts in Multimodal Large Language Models (MLLMs).
Protecting multimodal large language models against misleading visualizations (2026.acl-long)

Copied to clipboard

Challenge: MLLMs are robust to misleading visualizations, i.e., charts that distort the underlying data, leading readers to draw inaccurate conclusions.
Approach: They propose to use table-based QA and redrawing the visualization to improve QA performance on misleading visualizations.
Outcome: The proposed methods improve MLLM question-answering accuracy on misleading visualizations without compromising accuracy on non-misleading ones.
Unveiling Uncertainty: A Deep Dive into Calibration and Performance of Multimodal Large Language Models (2025.coling-main)

Copied to clipboard

Challenge: Multimodal large language models combine visual and textual data for tasks like image captioning and visual question answering.
Approach: They propose temperature scaling and iterative prompt optimization to calibrate MLLMs and enhance model reliability.
Outcome: The proposed techniques improve MLLMs and improve model reliability.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations