Challenge: Multimodal mathematical Reasoning (MMR) has attracted increasing attention for its ability to solve mathematical problems involving both textual and visual modalities.
Approach: They review the theoretical frameworks of multimodal reasoning and examine the challenges they face in visual math tasks.
Outcome: The proposed models can solve problems involving both textual and visual modalities.

Similar Papers

The Role of Visual Modality in Multimodal Mathematical Reasoning: Challenges and Insights (2025.acl-long)

Copied to clipboard

Challenge: Existing models that leverage visual information do not improve math reasoning performance . authors suggest that visual information is important for multimodal reasoning .
Approach: They propose a dataset to require image reliance for problem-solving and challenge models with similar, yet distinct, images that change the correct answer.
Outcome: The proposed model performance is unaffected by changes to or removal of images in the dataset.
A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challenges (2025.findings-acl)

Copied to clipboard

Challenge: This survey provides **the first comprehensive analysis of mathematical reasoning in the era of multimodal large language models** . integrating large language model with mathematical reasoning tasks is becoming significant as AI advances .
Approach: They review over 200 studies published since 2021 and examine the state-of-the-art developments in Math-LLMs . they identify five major challenges hindering the realization of AGI in this domain .
Outcome: The authors examine the state-of-the-art developments in Math-LLMs with a focus on multimodal settings.
MM-MATH: Advancing Multimodal Math Evaluation with Process Evaluation and Fine-grained Classification (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing benchmarks for multimodal reasoning in large multimodal models are underperforming on multimodal tasks.
Approach: They propose a benchmark for multimodal reasoning in large multimodal models, MM-MATH . MM's process evaluation employs LMM-as-a-judge to automatically analyze solution steps . diagram misinterpretation is the most common error, they find .
Outcome: The proposed model achieves only 31% accuracy, compared to 82% for humans.
We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning? (2025.acl-long)

Copied to clipboard

Challenge: Existing benchmarks focus more on end-to-end performance, but neglect the underlying principles of knowledge acquisition and generalization.
Approach: They propose a benchmark specifically designed to explore the problem-solving principles by decomposing 6.5K visual math problems into 10.9K step-level questions for evaluation.
Outcome: The proposed benchmark covers 6.5K visual math problems and 10.9K step-level questions spanning 5 layers of knowledge granularity and 67 hierarchical knowledge concepts.
Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing Multimodal Large Language Models (MLLMs) are predominantly trained on consistent visual-textual inputs, leaving open the question of whether they can handle semantic mismatches in layout-rich content.
Approach: They propose to use multimodal inconsistency reasoning to assess MLLMs' ability to reason about semantic mismatches in webpages, presentation slides, and posters.
Outcome: The proposed model outperforms open-source models in detecting inconsistencies in webpages, presentation slides, and posters while remaining vulnerable to inconsistent errors.
MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LMMs) struggle with simple tasks such as geometry, e.g., arithmetic, and reasoning.
Approach: They propose to leverage code as supervision for cross-modal alignment . they propose to use FigCodifier and ImgCode-8.6M to synthesize novel mathematical figures .
Outcome: The proposed model surpasses GPT-4o and Claude 3.5 Sonnet in the geometry problem-solving subset of MathVista, achieving improvements of 8.9% and 9.2%.
Multimodal Logical Inference System for Visual-Textual Entailment (P19-2)

Copied to clipboard

Challenge: Recent studies of multimodal inference provide challenging tasks such as visual question answering and visual reasoning.
Approach: They propose an unsupervised multimodal logical inference system that can prove entailment relations between texts and images by combing semantic parsing and theorem proving.
Outcome: The proposed system can handle semantically complex sentences for visual-textual inference.
MathSight: A Benchmark Exploring Have Vision-Language Models Really Seen in University-Level Mathematical Reasoning? (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks rarely isolate how much visual information contributes to reasoning . a growing collection of benchmarks has catalyzed rapid progress in multimodal reasoning - but how much it contributes remains unclear .
Approach: They propose a university-level multimodal mathematical reasoning benchmark to quantify the effect of visual input.
Outcome: The proposed benchmark disentangles and quantifies the effect of visual input on multimodal reasoning models.
MM-ChatAlign: A Novel Multimodal Reasoning Framework based on Large Language Models for Entity Alignment (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing MMEA methods rely on knowledge representation learning (KRL) to measure the similarity of entity embeddings.
Approach: They propose a framework that utilizes the visual reasoning abilities of MLLMs for multimodal entity alignment.
Outcome: The proposed framework integrates the visual reasoning abilities of MLLMs for multimodal entity alignment.
Exploring and Evaluating Multimodal Knowledge Reasoning Consistency of Multimodal Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: MLLMs have achieved significant breakthroughs in understanding across text and vision, but current models still face inconsistencies in reasoning outcomes.
Approach: They propose to evaluate multimodal large language models using a multimodal knowledge reasoning dataset to examine the extent of consistency degradation.
Outcome: The proposed evaluation tasks show that MLLMs are inefficient at integrating knowledge across modalities .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations