MathMixup: Boosting LLM Mathematical Reasoning with Difficulty-Controllable Data Synthesis and Curriculum Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing data synthesis methods suffer from limited diversity and lack precise control over problem difficulty, making them insufficient for efficient training paradigms such as curriculum learning. |
| Approach: | They propose a data synthesis paradigm that generates high-quality, difficulty-controllable mathematical reasoning problems through hybrid and decomposed strategies. |
| Outcome: | The proposed paradigm outperforms existing methods and improves mathematical reasoning abilities. |
Similar Papers
More Data or Better Data? A Critical Analysis of Data Selection and Synthesis for Mathematical Reasoning (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Despite various proposed data construction methods, their practical utility in real-world pipelines remains underexplored. |
| Approach: | They conduct a comprehensive analysis of open-source datasets and data synthesis techniques for mathematical reasoning under a unified pipeline designed to mirror training and deployment scenarios. |
| Outcome: | The proposed pipelines mirror training and deployment scenarios and are suitable for industrial applications. |
What Makes a Good Curriculum? Disentangling the Effects of Data Ordering on LLM Mathematical Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Curriculum learning (CL) orders data corpus by difficulty, but prior work employs disparate difficulty metrics and training setups. |
| Approach: | They propose a framework that decomposes curriculum difficulty into five dimensions: Problem Difficulty, Model Surprisal, Confidence Margin, Predictive Uncertainty and Decision Variability. |
| Outcome: | The proposed framework decomposes curriculum difficulty into five dimensions . the results show that no curriculum strategy dominates universally . |
RV-Syn: Rational and Verifiable Mathematical Reasoning Data Synthesis based on Structured Function Library (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for generating high-quality reasoning data are limited in quality and availability. |
| Approach: | They propose a method that constructs mathematical operations and generates verifiable graphs that are back-translated into complex problems. |
| Outcome: | The proposed method achieves a 6.3% performance gain over existing methods on LLaMA-3-8B and outperforms others with only half the training data (50k vs. 100k). |
FLAMES: Improving LLM Math Reasoning via a Fine-Grained Analysis of the Data Synthesis Pipeline (2025.findings-emnlp)
Copied to clipboard
Parker Seegmiller, Kartik Mehta, Soumya Saha, Chenyang Tao, Shereen Oraby, Arpit Gupta, Tagyoung Chung, Mohit Bansal, Nanyun Peng
| Challenge: | Recent work improving LLM math reasoning with synthetic data uses unique setups, making comparison of data synthesis strategies impractical. |
| Approach: | They propose a framework for LLM assessment of math reasoning with synthetic data . they use 10 existing data synthesis strategies and multiple other factors to study performance . |
| Outcome: | The proposed data synthesis strategies outperform public datasets on OlympiadBench, CollegeMath, GSMPlus and MATH. |
MathFusion: Enhancing Mathematical Problem-solving of LLM through Instruction Fusion (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown impressive progress in mathematical problem-solving . current approaches to enhance mathematical reasoning focus on instance-level modifications . |
| Approach: | They propose a framework that enhances mathematical reasoning through cross-problem instruction synthesis. |
| Outcome: | The proposed framework boosts mathematical reasoning by 18.0 points while maintaining high data efficiency. |
Breaking Language Barriers in Multilingual Mathematical Reasoning: Insights and Observations (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research focuses on developing powerful large language models for mathematical reasoning within monolingual languages. |
| Approach: | They propose to use translation to build powerful multilingual math reasoning models . they propose different training strategies to build xMR LLMs that outperform open-source LLM . |
| Outcome: | The proposed model outperforms open-source LLMs and surpasses ChatGPT in few-shot scenarios. |
CoinMath: Harnessing the Power of Coding Instruction for Math LLM (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown strong performance in solving mathematical problems, with code-based solutions proving particularly effective. |
| Approach: | They propose a learning strategy to enhance mathematical reasoning by diversifying the coding styles of code-based rationales. |
| Outcome: | The proposed learning strategy outperforms its baseline model, MAmmoTH, which uses code-based solutions. |
MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs (2024.acl-long)
Copied to clipboard
| Challenge: | Existing models have demonstrated outstanding capabilities in mathematical reasoning, but there is a performance gap between open-source models and closed-source ones. |
| Approach: | They propose a method for generating diverse and reliable math problems by leveraging the ground-truth solutions of the seed data. |
| Outcome: | The proposed model outperforms open-source models across five representative mathematical reasoning datasets. |
MARIO: MAth Reasoning with code Interpreter Output - A Reproducible Pipeline (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models lack mathematical reasoning, a hurdle on the path to true artificial general intelligence. |
| Approach: | They propose a protocol for fine-tuning large language models with a Python code interpreter to enhance the text analysis of the LLMs. |
| Outcome: | The proposed protocol improves the performance of a 7B-parameter LLM on the GSM8K and MATH datasets while allowing for an outlier-free value model-based inference method. |
Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing image instruction fine-tuning datasets do not fully exploit visual information to enhance multimodal reasoning capabilities of Large language models (LLMs). |
| Approach: | They propose a LLaVA-based model fine-tuned with MathV360K to bridge this gap by collecting 40K high-quality images with question-answer pairs from 24 existing datasets and synthesizing 320K new pairs. |
| Outcome: | The proposed model improves the multimodal reasoning capabilities of LLaVA-1.5 and demonstrates enhanced generalizability on the MMMU benchmark. |