Answer Convergence as a Signal for Early Stopping in Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | a systematic study suggests that chain-of-thought prompting is unnecessary for producing correct answers. |
| Approach: | They propose three inference-time strategies to improve model efficiency by boosting end-of-reasoning signals and early stopping . they propose a method that learns when to stop based on internal activations . |
| Outcome: | The proposed methods reduce token usage with little or no accuracy drop on natural questions . the proposed methods also reduce tokens by over 40% on naturalquestions . |
Similar Papers
Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters (2023.acl-long)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) prompting can dramatically improve the multi-step reasoning abilities of large language models (LLMs). |
| Approach: | They propose to use Chain-of-Thought (CoT) prompting to encourage the LLM to generate intermediate rationales for solving a problem by providing a series of reasoning steps in the demonstrations. |
| Outcome: | The proposed model can generate coherent lines of reasoning even with invalid demonstrations while still generating coherent lines during inference. |
Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Chain-of-Thought reasoning has driven recent gains of large language models (LLMs) on reasoning-intensive tasks by externalizing intermediate steps. |
| Approach: | They propose a training-free framework that adaptively determines when to stop reasoning to mitigate overthinking. |
| Outcome: | The proposed framework reduces token usage by 20-55% while maintaining or improving accuracy compared to standard CoT prompting. |
When Is Thinking Enough? Early Exit via Sufficiency Assessment for Efficient Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to early exit reasoning often rely on handcrafted or empirical indicators that are unreliable and impractical. |
| Approach: | They propose a framework that allows LRMs to assess the sufficiency of its chain-of-thought and determine the optimal point for early exit. |
| Outcome: | The proposed framework reduces reasoning length by 28.9%–34.9% with minimal performance loss, effectively mitigating overthinking. |
Think Faster Than Words: Efficient LLM Chain-of-Thought Reasoning via Dynamic Shortcut Decoding (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods that prune or employ early stopping to reduce latency often compromise reasoning reliability. |
| Approach: | They propose a shortcut decoding framework that integrates probes over internal hidden states with step-level entropy to detect convergence of reasoning during generation and adaptively selects between a fast-exit path and a stability-verified path to remove redundant steps while preserving answer correctness. |
| Outcome: | The proposed framework reduces token usage by approximately 35% and maintains accuracy comparable to full CoT decoding. |
Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Chain-of-thought (CoT) prompting is a technique to enhance the reasoning abilities of Large language models (LLMs) however, the reasoning chains of demonstrations are observed to be prone to errors, which can lead to incorrect reasoning during inference. |
| Approach: | They propose an iterative bootstrapping technique to enhance the reasoning abilities of Large language models (LLMs) by generating a series of reasoning steps to obtain the answer, and using the reasoning chains as exemplars to demonstrate the task. |
| Outcome: | The proposed method improves the performance of Large language models (LLMs) on three reasoning tasks on ten datasets. |
SyncThink: A Training-Free Strategy to Align Inference Termination with Reasoning Saturation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) achieve strong reasoning with Chain-of-Thought prompting, but long and redundant traces substantially increase inference cost. |
| Approach: | They propose a training-free and plug-and-play decoding method that reduces CoT overhead without modifying model weights. |
| Outcome: | Experiments on GSM8K, MMLU, GPQA, and BBH show that SyncThink achieves 62.00% average Top@1 accuracy using 656 generated tokens and 28.68s latency, compared to 61.22%, 2141 tokens, and 92.01s for full CoT decoding. |
ChainLM: Empowering Large Language Models with Improved Chain-of-Thought Prompting (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing CoT synthesis approaches focus on simpler reasoning tasks and result in inconsistent CoT prompts. |
| Approach: | They propose a framework for automatic generation of superior CoT prompts based on three major evolution strategies . they propose 'step-level debating' method where multiple debaters discuss each reasoning step to arrive at the correct answer. |
| Outcome: | The proposed framework can generate superior CoT prompts from a CoT dataset. |
Can Reasoning Path still be Effective as Input? Bridging Post-Reasoning to Chain-of-Thought Compression (2026.acl-long)
Copied to clipboard
Chengzhengxu Li, Xiaoming Liu, Zhaohan Zhang, Shengchao Liu, Guoxin Ma, Yu Lan, Cong Wang, Chao Shen
| Challenge: | Existing work on reducing CoT generation in reasoning impairs the necessary information for deriving the correct answer. |
| Approach: | They propose a reasoning paradigm that takes CoT as a part of context to simplify the reasoning task for Large Language Models (LLMs). |
| Outcome: | The proposed framework reduces the generation length of LLMs, but its effectiveness hinges on the efficiency and reliability of the contextual CoT generation. |
The Impact of Reasoning Step Length on Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Long reasoning steps in LLMs improve reasoning abilities, but the correlation between their effectiveness and the length of reasoning steps remains largely unknown. |
| Approach: | They conducted experiments that expand and compress the rationale reasoning steps within CoT demonstrations while keeping all other factors constant. |
| Outcome: | The results show that lengthening the reasoning steps in prompts significantly enhances LLMs’ reasoning abilities across multiple datasets. |
Self-Training Elicits Concise Reasoning in Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Chain-of-thought reasoning has enabled large language models to use additional computation through intermediate tokens to solve complex tasks, but current models often generate more tokens than necessary to accomplish the task, incurring extraneous inference costs. |
| Approach: | They propose to fine-tune models with self-generated concise reasoning paths obtained by best-of-N sampling and few-shot conditioning in task-specific settings to elicit concise reasoning. |
| Outcome: | The proposed method reduces output tokens by 30% on GSM8K and MATH while maintaining average accuracy. |