Papers with AIME2024
SIFT: Grounding LLM Reasoning in Contexts via Stickers (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Using a new approach, we can improve the pass@1 accuracy of LLM reasoning in large language models. |
| Approach: | They propose a method that leverages increasing inference-time compute to ground LLM reasoning in contexts. |
| Outcome: | The proposed approach improves pass@1 accuracy of DeepSeek-R1 on AIME2024 from 78.33% to **85.67%** and that on Aime2025 from 69.8% to **77.33%**. |
Curing Miracle Steps in LLM Mathematical Reasoning with Rubric Rewards (2026.acl-long)
Copied to clipboard
Youliang Yuan, Qiuyang Mang, Jingbang Chen, Hong Wan, Xiaoyuan Liu, Junjielong Xu, Jen-tse Huang, Wenxuan Wang, Wenxiang Jiao, Pinjia He
| Challenge: | Existing models are susceptible to reward hacking, leading to a substantial overestimation of a model's reasoning ability. |
| Approach: | They propose a Rubric Reward Model that rewards the entire reasoning trajectory against problem-specific rubrics. |
| Outcome: | The proposed model outperforms outcome-only supervision on four math benchmarks and boosts Verified Pass@1024 from 26.7% to 62.6% and reduces the incidence of Miracle Steps by 71%. |
Less is More: Improving LLM Reasoning with Minimal Test-Time Intervention (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have focused on test-time scaling to improve reasoning quality but at the cost of efficiency. |
| Approach: | They propose a training-free framework that enhances reasoning accuracy and stability with minimal overhead. |
| Outcome: | The proposed framework yields consistent gains across general, coding, and STEM tasks while remaining highly efficient. |
PromptCoT: Synthesizing Olympiad-level Problems for Mathematical Reasoning in Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | PromptCoT is a novel approach for synthesizing Olympiad-level math problems . it integrates rationale generation and mathematical concepts to generate complex problems based on concepts and rationale behind problem construction. |
| Approach: | They propose a method for automatically generating high-quality Olympiad-level math problems . they use mathematical concepts and the rationale behind problem construction to synthesize complex problems based on mathematical concepts . |
| Outcome: | The proposed method outperforms existing problem generation methods on benchmarks including GSM8K, MATH-500, and AIME2024. |
Weak2Wise: An Automated, Lightweight Framework for Weak-LLM-Friendly Reasoning Synthesis (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to finetuning large language models rely on expensive manual annotations or auxiliary models and fail to address the unique constraints of smaller "weak" LLMs. |
| Approach: | Weak2Wise is a fully automated framework for synthesizing highquality, weak-LLM-friendly reasoning traces. |
| Outcome: | Weak2Wise is a fully automated, lightweight framework for synthesizing highquality, weak-LLM-friendly reasoning traces. |
PiCSAR: Probabilistic Confidence Selection and Ranking for Reasoning Chains (2026.findings-acl)
Copied to clipboard
Joshua Ong Jun Leang, Zheng Zhao, Aryo Pradipta Gema, Sohee Yang, Wai-Chung Kwan, Xuanli He, Wenda Li, Pasquale Minervini, Eleonora Giunchiglia, Shay B Cohen
| Challenge: | Recent studies show that large reasoning models (LLMs) achieve strong performance on complex reasoning tasks. |
| Approach: | They propose a method that scores each candidate generation using the joint log-likelihood of the reasoning and final answer. |
| Outcome: | The proposed method outperforms baselines with 2x fewer samples in 20 out of 25 comparisons. |
Prior Prompt Engineering for Reinforcement Fine-Tuning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have focused on algorithms, reward shaping, and data curation, but prior prompt engineering is understudied. |
| Approach: | They investigate prior prompt engineering (pPE) in reinforcement fine-tuning . they translate five representative iPE strategies into corresponding pPE approaches . |
| Outcome: | The proposed approaches outperform iPE-prompted models on in-domain and out-of-domain benchmarks. |