VisuoThink: Empowering LVLM Reasoning with Multimodal Tree Search (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to large vision-language models fail to capture interleaved nature of human visual-verbal reasoning processes. |
| Approach: | They propose a framework that integrates visuospatial and linguistic domains to facilitate multimodal slow thinking by enabling progressive visual-textual reasoning. |
| Outcome: | Experiments show that VisuoThink significantly improves reasoning capabilities even without fine-tuning. |
Similar Papers
VReST: Enhancing Reasoning in Large Vision-Language Models through Tree Search and Self-Reward Mechanism (2025.acl-long)
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) have shown exceptional performance in multimodal tasks, but their effectiveness in complex visual reasoning is constrained. |
| Approach: | They propose a training-free approach that enhances Reasoning in Large Vision-Language Models . they propose integrating Monte Carlo Tree Search and Self-Reward mechanisms into the reasoning tree . |
| Outcome: | The proposed approach surpasses current prompting methods and secures state-of-the-art performance across three multimodal reasoning benchmarks. |
DynaThink: Fast or Slow? A Dynamic Decision-Making Framework for Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have emerged as prominent foundation models for diverse applications due to their outstanding ability to understand and generate humanlike text. |
| Approach: | They propose a dynamic decision-making framework that categorizes tasks into two distinct pathways: 'Fast' and 'Slow' they propose 'self-consistency' strategy to replace the straight-forward decoding method used in COT prompting . |
| Outcome: | The proposed method achieves more than 3% increase in accuracy with lower cost on five popular reasoning benchmarks. |
Can MLLMs Reason Beyond Language? VisReason: A Comprehensive Benchmark for Vision-Centric Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in multimodal large language models demonstrate strong performance on visual reasoning benchmarks. |
| Approach: | They propose a benchmark for vision-centric reasoning that integrates visual and textual information for non-trivial reasoning. |
| Outcome: | The proposed benchmark exposes gaps between humans and current MLLMs and reveals limited benefits from test-time reasoning strategies. |
ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) have shown impressive capabilities in vision-language understanding but their visual input remains fixed throughout the reasoning process. |
| Approach: | They propose a model-agnostic tree search algorithm tailored for vision-level reasoning that allows MLLMs to explore textual tokens while visual input remains fixed throughout reasoning process. |
| Outcome: | The proposed algorithm outperforms strong large models such as GPT-4o on high-resolution benchmarks and improves performance on a series of elaborate high-level benchmarks. |
Reasoning Beyond Literal: Cross-style Multimodal Reasoning for Figurative Language Understanding (2026.findings-eacl)
Copied to clipboard
| Challenge: | figurative language is essential for expressing intent, emotion, and perspective . figural language is often dependent on Styles Reasoning, causing incongruities between expressions . |
| Approach: | They propose a framework that induces reasoning capabilities to compact vision–language models . figurative language is essential in expressing intent, emotion, and perspective . |
| Outcome: | The proposed framework can interpret multimodal figurative language, provide transparent reasoning traces, and generalize across multiple figurativ styles. |
Dynamic Parallel Tree Search for Efficient LLM Reasoning (2025.acl-long)
Copied to clipboard
Yifu Ding, Wentao Jiang, Shunyu Liu, Yongcheng Jing, Jinyang Guo, Yingjie Wang, Jing Zhang, Zengmao Wang, Ziwei Liu, Bo Du, Xianglong Liu, Dacheng Tao
| Challenge: | Recent methods focus on search accuracy while overlooking computational efficiency. |
| Approach: | They propose a parallelism framework that dynamically optimizes reasoning path in inference. |
| Outcome: | The proposed framework improves efficiency by 2-4 on average while maintaining or even surpassing existing reasoning algorithms in accuracy. |
Look Less, Reason More: Rollout-Guided Adaptive Pixel-Space Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent work has shown promise by incorporating pixel-level visual information into the reasoning process, enabling VLMs to access high-resolution visual details during their thought process. |
| Approach: | They propose a framework that dynamically determines necessary pixel-level operations based on the input query. |
| Outcome: | The proposed model achieves 73.4% accuracy on HR-Bench 4K while maintaining a tool usage ratio of only 20.1%, improving accuracy and reducing tool usage by 66.5% compared to the previous methods. |
Look and Think: Efficient Multimodal Reasoning via Modality-Decoupled Compression (2026.findings-acl)
Copied to clipboard
| Challenge: | Multimodal large language models have strong performance on visual question answering benchmarks . however, their inference efficiency is severely constrained by the rapidly growing context . |
| Approach: | They propose a modality-decoupled compression method that enables efficient multimodal inference . they propose to evict visual tokens whenever visual grounding is unnecessary . |
| Outcome: | The proposed method reduces the average context length by up to 57% while maintaining comparable performance to the standard MLLM baseline. |
TraVLR: Now You See It, Now You Don’t! A Bimodal Dataset for Evaluating Visio-Linguistic Reasoning (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing visio-linguistic (V+L) models do not represent visual and linguistic concepts in a unified space. |
| Approach: | They propose to use cross-modal transfer to evaluate the extent to which visio-linguistic (V+L) representations are represented in a unified space. |
| Outcome: | The proposed evaluation settings include cross-modal transfer and a global accuracy score on the entire dataset making the specific sources of success and failure difficult to diagnose. |
Fast or Slow? Integrating Fast Intuition and Deliberate Thinking for Enhancing Visual Question Answering (2025.acl-short)
Copied to clipboard
| Challenge: | Current approaches generate visual markers for all questions, generating excessive visual markers. |
| Approach: | They propose a plug-and-play approach that adapts to the complexity of questions . they propose combining fast intuitive judgments with deliberate analytical reasoning . |
| Outcome: | The proposed approach improves performance on four benchmarks on ScienceQA, TextQA, VizWiz, and MME. |