Challenge: Various vision-language models (VLMs) have made significant progress in multimodal tasks, but they still struggle with geometry problems.
Approach: They propose a vision-language model that leverages modular code-finetuning to generate and execute code using a predefined geometry function library.
Outcome: The proposed model improves geometric reasoning abilities by 16% on a GeomVerse dataset compared to other methods.

Similar Papers

MathCoder-VL: Bridging Vision and Code for Enhanced Multimodal Mathematical Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LMMs) struggle with simple tasks such as geometry, e.g., arithmetic, and reasoning.
Approach: They propose to leverage code as supervision for cross-modal alignment . they propose to use FigCodifier and ImgCode-8.6M to synthesize novel mathematical figures .
Outcome: The proposed model surpasses GPT-4o and Claude 3.5 Sonnet in the geometry problem-solving subset of MathVista, achieving improvements of 8.9% and 9.2%.
MapCoder: Multi-Agent Code Generation for Competitive Problem Solving (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have impressive proficiency in natural language processing, but performance in code generation tasks remains limited.
Approach: They propose a framework that emulates the full cycle of program synthesis as observed in humans.
Outcome: The proposed framework replicates the full cycle of program synthesis as observed in human developers.
PseudoGD: Enhancing Spatial Reasoning in Vision-Language Models through Pseudo Geometric Knowledge Distillation (2026.findings-acl)

Copied to clipboard

Challenge: Recent Large Vision-Language Models (LVLMs) have shown remarkable success in general semantic understanding, but struggle with 3D spatial reasoning tasks.
Approach: They propose a framework to help vision encoders internalize 3D geometric information using only standard 2D images.
Outcome: The proposed framework achieves State-of-the-Art (SOTA) performance across various model architectures.
3D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation (2025.findings-emnlp)

Copied to clipboard

Challenge: Vision-Language Models (VLMs) have shown remarkable performance on diverse visual and linguistic tasks, yet they remain limited in their understanding of 3D spatial structures.
Approach: They propose a framework that injects human-inspired geometric cues into pretrained VLMs . they use sparse correspondences, relative depth relations and dense cost volumes .
Outcome: The proposed framework outperforms existing methods on vision-language reasoning and 3D perception benchmarks.
GeoDANO: Geometric VLM with Domain Agnostic Vision Encoder (2025.findings-emnlp)

Copied to clipboard

Challenge: GeoDANO is a geometric vision-language model with a domain-agnostic vision encoder . it is currently limited to recognizing geometric features in general-purpose VLMs .
Approach: They propose a geometric vision-language model with a domain-agnostic vision encoder for plane geometry problems.
Outcome: The proposed model outperforms vision encoders in recognizing geometric features . it outperformed specialized methods for plane geometry problems and GPT-4o on MathVerse .
GeoGPT4V: Towards Geometric Multi-modal Large Language Models with Geometric Image Generation (2024.emnlp-main)

Copied to clipboard

Challenge: Existing datasets are too challenging for direct model learning or suffer from misalignment between text and images.
Approach: They propose a pipeline that leverages GPT-4 and GPT4V to generate geometry problems with aligned text and images, facilitating model learning.
Outcome: The proposed pipeline generates 4.9K geometry problems with aligned text and images, facilitating model learning.
Geoparsing: Diagram Parsing for Plane and Solid Geometry with a Unified Formal Language (2026.findings-acl)

Copied to clipboard

Challenge: Recent advances in Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across various vision reasoning tasks.
Approach: They propose a unified formal language that integrates plane and solid geometry, comprehensively covering geometric structures and semantic relations.
Outcome: The proposed language achieves state-of-the-art parsing performance and significantly boosts MLLMs’ capabilities for downstream geometry reasoning tasks.
GeoPQA: Bridging the Visual Perception Gap in MLLMs for Geometric Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in reinforcement learning (RL) have enhanced the reasoning abilities of large language models, but the impact on multimodal LLMs is limited.
Approach: They propose a two-stage RL framework that enhances visual perception and fosters reasoning capabilities.
Outcome: The proposed framework improves geometric reasoning by 9.7% and problem-solving by 9.1% compared to direct reasoning training approach.
Generating Equation by Utilizing Operators : GEO model (2020.coling-main)

Copied to clipboard

Challenge: Existing neural models that use hand-crafted features are expensive and lack domain-specific knowledge.
Approach: They propose a GEO model that uses operator-based features to generate equations using natural language sentences.
Outcome: The proposed model outperforms state-of-the-art models on two datasets and 82.1% in ALG514.
MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problems (2024.findings-emnlp)

Copied to clipboard

Challenge: Programming often involves translating detailed and complex specifications into code . current state-of-the-art models struggle to solve these problems, a new study shows .
Approach: They propose a multi-modal coding dataset to evaluate algorithmic problem-solving skills in visually rich contexts.
Outcome: The proposed model lacks powerful vision-code models due to the extreme demand for reasoning abilities.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations