SynthRL: Scaling Visual Reasoning with Verifiable Data Synthesis (2026.findings-acl)
Copied to clipboard
| Challenge: | SynthRL synthesizes over 3.3K additional verifiable, challenging questions from approximately 8K seed samples. |
| Approach: | They propose a scalable and guaranteed pipeline for automatic data scaling in reasoning-oriented RL training. |
| Outcome: | The proposed pipeline synthesizes over 3.3K additional verifiable, challenging questions from approximately 8K seed samples. |
Similar Papers
SCALER: Synthetic Scalable Adaptive Learning Environment for Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Reinforcement learning (RL) is a principled way to enhance the reasoning capabilities of large language models, yet its effectiveness hinges on training signals that remain informative as models evolve. |
| Approach: | They propose a framework that sustains effective learning signals through adaptive environment design that transforms real-world programming problems into verifiable reasoning environments with controllable difficulty and unbounded instance generation. |
| Outcome: | The proposed framework outperforms baselines across diverse reasoning benchmarks and exhibits more stable, long-horizon training dynamics. |
PuzzleClone: A DSL-Powered Framework for Synthesizing Verifiable Data (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets with verifiable answers are limited in reliability, diversity, and scalability . a new approach to generate verifikatable data at scale is needed to improve models' performance . |
| Approach: | They propose a formal framework for synthesizing verifiable data at scale using a novel DSL-driven approach. |
| Outcome: | The proposed framework improves performance on a wide range of puzzles and logic benchmarks. |
SLR: Automated Synthesis for Scalable Logical Reasoning (2026.acl-long)
Copied to clipboard
Lukas Helff, Ahmad Omar, Felix Friedrich, Antonia Wüst, Hikaru Shindo, Rupert Mitchell, Tim Woydt, Patrick Schramowski, Wolfgang Stammer, Kristian Kersting
| Challenge: | Existing benchmarks intended to evaluate reasoning capabilities emphasize deductive reasoning, where conclusions necessarily follow from given premises. |
| Approach: | They propose an end-to-end framework for systematic evaluation and training of Large Language Models via Scalable Logical Reasoning. |
| Outcome: | The proposed framework doubles Llama-3-8B accuracy on SLR-Bench, achieving parity with Gemini-Flash-Thinking at a fraction of computational cost. |
RV-Syn: Rational and Verifiable Mathematical Reasoning Data Synthesis based on Structured Function Library (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for generating high-quality reasoning data are limited in quality and availability. |
| Approach: | They propose a method that constructs mathematical operations and generates verifiable graphs that are back-translated into complex problems. |
| Outcome: | The proposed method achieves a 6.3% performance gain over existing methods on LLaMA-3-8B and outperforms others with only half the training data (50k vs. 100k). |
Knowledge-to-Verification: Exploring RLVR for LLMs in Knowledge-Intensive Domains (2026.acl-long)
Copied to clipboard
Zhonghang Yuan, Zhefan Wang, Fang Hu, Zihong Chen, Jinzhe Li, Gang Li, Jie Ying, Huanjun Kong, Songyang Zhang, Nanqing Dong
| Challenge: | Recent large language models (LLMs) have demonstrated remarkable progress in reasoning, but their applications on knowledge-intensive domains have not been explored due to the scarcity of high-quality verifiable data. |
| Approach: | They propose a framework that extends reinforcement learning with verifiable rewards (RLVR) to knowledge-intensive domains through automated verififiability data synthesis while enabling verification of the LLM's reasoning process. |
| Outcome: | Extensive experiments show that the proposed framework enhances the reasoning of large language models in knowledge-intensive domains without significantly compromising the model’s general capabilities. |
Scale Down to Speed Up: Dynamic Data Selection for Reinforcement Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to Reinforcement Learning (RL) rely on massive static datasets, leading to computational inefficiency and redundant gradient updates. |
| Approach: | They propose a data-centric RL framework that dynamically selects the most informative training samples to optimize RL for mathematical reasoning. |
| Outcome: | The proposed framework achieves comparable performance to full-data training methods while requiring only 1.5K samples instead of 220K, reducing training time from 13 days to just 4 hours on 8A800 GPUs. |
Learning What Matters: Dynamic Dimension Selection and Aggregation for Interpretable Vision-Language Reward Modeling (2026.acl-long)
Copied to clipboard
Qiyuan Chen, Hongsen Huang, Jiahe Chen, Qian Shao, Jintai Chen, Hongxia Xu, Renjie Hua, Ren Chuan, Jian Wu
| Challenge: | Existing multimodal reward models are interpretable but slow, while discriminative ones are opaque "black boxes." |
| Approach: | They propose a framework that dynamically decomposes evaluation into granular, interpretable dimensions. |
| Outcome: | The proposed framework outperforms open-source reward models on benchmarks like VL-RewardBench. |
ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch (2026.acl-long)
Copied to clipboard
Zheng Liu, Honglin Lin, Xiaoyang Wang, Xin Gao, Yu Li, Mengzhang Cai, Yun Zhu, Zhanping Zhong, Qizhi Pei, Zhuoshi Pan, Xiaoran Shang, Conghui He, Bin Cui, Wentao Zhang, Lijun Wu
| Challenge: | Existing open-source vision language models lack high-quality training data for chart reasoning . current models are simplistic and repetitive, while associated QA pairs are prone to hallucinations . |
| Approach: | They propose a framework to synthesize complex charts and reliable reasoning data from scratch. |
| Outcome: | Experimental results show that ChartVerse-8B surpasses existing models in QA and difficulty . lack of high-quality training data hampers development of open-source models . |
Scaling is Not All You Need: Clinical-Oriented Reinforcement Learning Makes Parameter-Efficient Clinical Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models are increasingly used in medicine, but expert-level clinical reasoning remains a high-complexity, high-stakes frontier. |
| Approach: | They propose to train clinical reasoning models using a Reasoning-Oriented Data Strategy based on topological synthesis and CoT cold-start. |
| Outcome: | The proposed pipeline outperforms existing models and outperformed the strongest open-source alternatives up to 671B in MedXpertQA. |
Does RLVR Extend Reasoning Boundaries? Investigating Capability Expansion in Vision-Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Recent studies suggest that RLVR amplifies behaviors inherent to the pre-training distribution rather than inducing new capabilities. |
| Approach: | They propose a framework for RLVR that extends the spatial reasoning boundary . they use a mapping framework where the difficulty is precisely regulated by path length and number of turns . |
| Outcome: | The proposed framework extends the spatial reasoning boundary on two real-world navigation benchmarks. |