SceneAlign: Aligning Multimodal Reasoning to Scene Graphs in Complex Visual Scenes (2026.acl-long)
Copied to clipboard
Chuhan Wang, Xintong Li, Jennifer Yuntong Zhang, Junda Wu, Chengkai Huang, Lina Yao, Julian McAuley, Jingbo Shang
| Challenge: | Existing preference-based approaches fail to address this challenge by exploiting language priors to bypass visual grounding. |
| Approach: | They propose a framework that leverages scene graphs as structured visual information to perform controllable structural interventions. |
| Outcome: | The proposed framework improves answer accuracy and reasoning faithfulness across seven visual reasoning benchmarks. |
Similar Papers
LayAlign: Enhancing Multilingual Reasoning in Large Language Models via Layer-Wise Adaptive Fusion and Alignment Strategy (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are pretrained on multilingual corpora but exhibit suboptimal performance on low-resource languages. |
| Approach: | They propose a framework that integrates representations from all encoder layers and an adaptive fusion-enhanced attention mechanism to enable layer-wise interaction between the LLM and the multilingual encoder. |
| Outcome: | Experiments on multilingual reasoning tasks show that the proposed framework outperforms baselines. |
A Survey of Multimodal Mathematical Reasoning: From Perception, Alignment to Reasoning (2026.acl-long)
Copied to clipboard
Tianyu Yang, Sihong Wu, Yilun Zhao, Zhenwen Liang, Lisen Dai, Chen Zhao, Minhao Cheng, Arman Cohan, Xiangliang Zhang
| Challenge: | Multimodal mathematical Reasoning (MMR) has attracted increasing attention for its ability to solve mathematical problems involving both textual and visual modalities. |
| Approach: | They review the theoretical frameworks of multimodal reasoning and examine the challenges they face in visual math tasks. |
| Outcome: | The proposed models can solve problems involving both textual and visual modalities. |
Mitigating Hallucinations in Large Vision-Language Models via Entity-Centric Multimodal Preference Optimization (2025.emnlp-main)
Copied to clipboard
Jiulong Wu, Zhengliang Shi, Shuaiqiang Wang, Jizhou Huang, Dawei Yin, Lingyong Yan, Min Cao, Min Zhang
| Challenge: | Existing preference alignment methods focus on aligning model responses with human preferences while neglecting image-text modality alignment. |
| Approach: | They propose Entity-centric Multimodal Preference Optimization to improve modality alignment . they use open-source instruction datasets to automatically construct high-quality preference data . |
| Outcome: | The proposed approach reduces hallucination rates by 80.4% on Object HalBench and 52.6% on MM HalBech. |
Joint Multimodal Preference Optimization for Fine-Grained Visual-Textual Alignment (2026.findings-eacl)
Copied to clipboard
| Challenge: | Recent research has focused on addressing multimodal hallucinations in Large Vision-Language Models (LVLMs) however, these methods lack fine-grained visual contrast mechanisms and rely on single-margin optimization. |
| Approach: | They propose a framework that integrates text-conditioned preference loss with visual ranking-based objective. |
| Outcome: | The proposed framework improves cross-modal alignment and fine-grained visual grounding. |
Multimodal Causal Reasoning Benchmark: Challenging Multimodal Large Language Models to Discern Causal Links Across Modalities (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing MLLMs lack robustness in multimodal causal reasoning compared to their performance in textual settings. |
| Approach: | They propose a novel multimodal chain-of-thought (CoT) reasoning benchmark that leverages siamese images and text pairs to challenge MLLMs. |
| Outcome: | The proposed benchmark leverages siamese images and text pairs to challenge MLLMs. |
Reasoning Beyond Literal: Cross-style Multimodal Reasoning for Figurative Language Understanding (2026.findings-eacl)
Copied to clipboard
| Challenge: | figurative language is essential for expressing intent, emotion, and perspective . figural language is often dependent on Styles Reasoning, causing incongruities between expressions . |
| Approach: | They propose a framework that induces reasoning capabilities to compact vision–language models . figurative language is essential in expressing intent, emotion, and perspective . |
| Outcome: | The proposed framework can interpret multimodal figurative language, provide transparent reasoning traces, and generalize across multiple figurativ styles. |
MetaAlign: Align Large Language Models with Diverse Preferences during Inference Time (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to align large language models with human preferences often result in a static alignment that cannot account for the diversity of human preferences in practical applications. |
| Approach: | They propose a method to help large language models dynamically align with various explicit or implicit preferences specified at inference time. |
| Outcome: | The proposed method can help LLMs dynamically align with various explicit or implicit preferences specified at the inference stage, validating the feasibility of MetaAlign. |
Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for Improved Vision-Language Compositionality (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have highlighted severe limitations of contrastive learning models in their ability to perform compositional reasoning over objects, attributes, and relations. |
| Approach: | They propose a graph decomposition framework and negative mining techniques to improve attribute binding and relation understanding of scene graphs. |
| Outcome: | The proposed approach improves attribute binding, relation understanding, generalization, and productivity on multiple benchmarks. |
Mitigating Safety Context Amnesia in Multimodal Reasoning Models via Intent-Guided Safety Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in Multimodal Large Reasoning Models (MLRMs) have enabled explicit chain-of-thought inference across vision and language, improving performance on complex cognitive tasks. |
| Approach: | They propose an inference-time defense that uses a percept decoupler to extract objective visual evidence into a structured intent output and a cognitive arbiter to enforce explicit safety constraints prior to generation. |
| Outcome: | The proposed defense improves defense success rates by over 62% compared to baselines while preserving task utility. |
Faithful-First Reasoning, Planning, and Acting for Multimodal LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing efforts to improve task accuracy or enrich COT generation are lacking in multimodal large language models. |
| Approach: | They propose a Faithful-First Reasoning, Planning, and Acting framework that evaluates faithfulness of intermediate reasoning and uses it to plan and execute faithfulness-aware actions during inference. |
| Outcome: | The proposed framework improves perceptual faithfulness by up to 24% over prompt-based and tool-augmented reasoning frameworks without degrading task accuracy. |