AutoPRM: Automating Procedural Supervision for Multi-Step Reasoning via Controllable Question Decomposition (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have shown promise in multi-step reasoning tasks, yet relying on extensive manual labeling to provide procedural feedback remains a significant impediment. |
| Approach: | They propose a self-supervised framework that decomposes complex problems into manageable subquestions with a controllable granularity switch and sequentially applies reinforcement learning to iteratively improve the subquest solver. |
| Outcome: | The proposed framework improves performance on mathematical and commonsense reasoning tasks over SOTA. |
Similar Papers
Reasoning Up the Instruction Ladder for Controllable Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Current models struggle to balance competing directives, causing conflicting instructions. |
| Approach: | They propose to reframe instruction hierarchy resolution as a reasoning task . they use a training dataset to enable this capability by transferring general reasoning capabilities to instruction prioritization . |
| Outcome: | The proposed method improves on safety-critical scenarios beyond the training distribution and jailbreaks. |
LM2: A Simple Society of Language Models Solves Complex Reasoning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies show that providing guidance via decomposing the original question into multiple subproblems elicits more robustness in LLM reasoning. |
| Approach: | They propose a language-based decomposition, solution and verification framework that modularizes the decomposer, solution, and verification into three different language models. |
| Outcome: | The proposed model outperforms existing methods on in- and out-domain reasoning problems, outperforming the best baselines by 8.1% on MATH, 7.71% on JEEBench, and 9.7% on MedQA problems. |
Let’s Simplify Step by Step: Guiding LLM Towards Multilingual Unsupervised Proficiency-Controlled Sentence Simplification (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models demonstrate limited capability in proficiency-controlled sentence simplification when simplifying across large readability levels. |
| Approach: | They propose a framework that decomposes complex simplifications into manageable steps through dynamic path planning, semantic-aware exemplar selection, and chain-of-thought generation with conversation history for coherent reasoning. |
| Outcome: | The proposed framework reduces computational steps while improving simplification effectiveness on five languages across two benchmarks. |
AutoPlan: Automatic Planning of Interactive Decision-Making Tasks With Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for making decisions in grounded environments require costly gradient computation or lengthy in-context demonstrations. |
| Approach: | They propose an approach to guide LLM-based agents to accomplish interactive decision-making tasks by using an LLM prompt and a task-solving plan. |
| Outcome: | The proposed approach outperforms human-written demonstrations on ALFWorld and HotpotQA by 8%. |
Aligning Large Language Models for Controllable Recommendations (2024.acl-long)
Copied to clipboard
| Challenge: | Existing literature focuses on integrating domain-specific knowledge into LLMs to enhance accuracy using a fixed task template. |
| Approach: | They propose a collection of supervised learning tasks augmented with labels derived from a conventional recommender model to improve LLMs’ proficiency in adhering to recommendation-specific instructions. |
| Outcome: | The proposed approach significantly improves the capability of LLMs to respond to instructions within recommender systems, reducing formatting errors while maintaining a high level of accuracy. |
AgentPro: Enhancing LLM Agents with Automated Process Supervision (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing frameworks lack explicit supervision during the reasoning process, which may lead to error propagation across reasoning chains. |
| Approach: | They propose a framework which automates process supervision for large language model agents by automatically generating step-level annotations and developing a process reward model based on these annotations. |
| Outcome: | The proposed framework outperforms existing agent-based methods on four datasets and achieves a 6.32% increase in accuracy. |
Small Language Models Fine-tuned to Coordinate Larger Language Models improve Complex Reasoning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent attempts at prompt decomposition toward solving complex, multi-step reasoning problems depend on the ability of the LLM to simultaneously decompose and solve the problem. |
| Approach: | They propose a decomposition generator that decomposes complex problems into subproblems that require fewer reasoning steps. |
| Outcome: | The proposed method can produce competitive or even better performance compared to its larger successor, GPT-4. |
LLM2: Let Large Language Models Harness System 2 Reasoning (2025.naacl-short)
Copied to clipboard
| Challenge: | Empirical results on mathematical reasoning benchmarks substantiate the efficacy of Large language models (LLMs). |
| Approach: | They propose a framework that combines an LLM with a process-based verifier to generate plausible candidates and provide timely process-driven feedback to distinguish desirable and undesirable outputs. |
| Outcome: | Empirical results show that LLM2 improves accuracy on GSM8K and self-consistency increases major@20 accuracy. |
Current Advances in LLM Reasoning (2026.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial examines comprehensive evaluation strategies to assess the reasoning abilities of large language models (LLMs) advanced inference time methods and post-training methods that aim to make LLMs think more like humans are discussed in this tutorial. |
| Approach: | This tutorial explores comprehensive evaluation strategies to assess the reasoning abilities of large language models (LLMs) and discusses two types of methods to improve models’ reasoning: advanced inference time methods, structured and self-improvement inference methods, and post-training methods, such as RLHF, DPO, and GRPO. |
| Outcome: | This tutorial examines evaluation strategies to assess the reasoning abilities of large language models and discusses two types of methods to improve models’ reasoning. |
StitchLLM: Serving LLMs, One Block at a Time (2025.acl-long)
Copied to clipboard
Bodun Hu, Shuozhe Li, Saurabh Agarwal, Myungjin Lee, Akshay Jajoo, Jiamin Li, Le Xu, Geon-Woo Kim, Donghyun Kim, Hong Xu, Amy Zhang, Aditya Akella
| Challenge: | Existing techniques like distillation and pruning are not efficient for large language models. |
| Approach: | They propose a dynamic model routing framework that uses a powerful bottom model to process all queries and a lightweight routing mechanism to allocate computational resources appropriately. |
| Outcome: | The proposed framework improves system throughput while minimizing performance degradation. |