| Challenge: | Existing self-reflection mechanisms are reactive and inefficient for large language models . a fundamental tension persists between the ability to execute complex multi-step reasoning and the ability of the model to generate coherent traces. |
| Approach: | They propose a test-time framework that reflects before generating at uncertain points . SRGen utilizes dynamic entropy thresholding to identify high-uncertainty tokens . |
| Outcome: | The proposed framework can significantly strengthen large language models' reasoning process. |
Similar Papers
Think Twice, Generate Once: Safeguarding by Progressive Self-Reflection (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models generate coherent and contextually relevant text, but their deployment raises significant concerns about the potential for harmful or inappropriate content. |
| Approach: | They propose a novel inference-time technique that empowers LLMs to self-monitor and correct their outputs dynamically. |
| Outcome: | The proposed method reduces the attack success rate from 77.47% to 5.86%, to Llama-3.1-8B base from 89.70% to 5.56%, and to Qwen2.5-7B-Instruct from 44.44% to 3.84%, without additional training. |
When Hindsight is Not 20/20: Testing Limits on Reflective Thinking in Large Language Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Recent studies suggest that self-reflective prompting can significantly enhance the reasoning capabilities of Large Language Models (LLMs). |
| Approach: | They propose guidelines for when to implement self-reflection in Large Language Models. |
| Outcome: | The proposed approach improves the reasoning capabilities of Large Language Models under a more stringent evaluation setting, and reduces tendency toward majority voting. |
ReflexiCoder: Teaching Large Language Models to Self-Reflect on Generated Code and Self-Correct It via Reinforcement Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing iterative refinement strategies that generate solutions in a single forward pass often hit a performance ceiling on complex algorithmic tasks. |
| Approach: | They propose a reinforcement learning framework that internalizes the structured reasoning trajectory directly into the model’s weights. |
| Outcome: | The proposed framework achieves 94.51% (87.20%) on HumanEval, 81.80% (78.57%) on MBPP, 35.00% on BigCodeBench, 52.21% on LiveCodeBech, and 37.34% on CodeForces in a single-attempt setting. |
Self-Reflection Improves Safety of Large Reasoning Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing safety alignment methods are shallow and do not address deeper risks and attacks in reasoning processes. |
| Approach: | They propose a technique that introduces a special Self-Reflection token to enable LRMs to perform self-reflection during generation and recover from harmful outputs. |
| Outcome: | The proposed approach outperforms the baseline model in terms of safety and helpfulness, and significantly improves model safety without adversarial training. |
Instruct-of-Reflection: Enhancing Large Language Models Iterative Reflection Capabilities via Dynamic-Meta Instruction (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches involve models iterating and improving their previous responses based on internal reflection ability or external feedback. |
| Approach: | They propose a reflection framework that leverages meta-thoughts and self-consistency to enhance the iterative reflection capability of Large LanguageModels. |
| Outcome: | The proposed framework achieves an average improvement of 10.1% over established baselines in mathematical and commonsense reasoning tasks, highlighting its efficacy and applicability. |
Towards Verifiable Text Generation with Evolving Memory and Self-Reflection (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) often produce factually incorrect information, also known as hallucination. |
| Approach: | They propose a framework for verifiable text generation with evolving memory and self-reflection that incorporates long-term memory to retain documents and recent documents. |
| Outcome: | The proposed framework outperforms baselines on five datasets across three knowledge-intensive tasks. |
DSVD: Dynamic Self-Verify Decoding for Faithful Generation in Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to reliability of large language models often lack self-correction or use costly post-hoc verification. |
| Approach: | They propose a decoding framework that enhances generation reliability through real-time hallucination detection and efficient error correction. |
| Outcome: | Extensive experiments across five benchmarks show the proposed framework improves truthfulness and factual accuracy. |
Seer Self-Consistency: Advance Budget Estimation for Adaptive Test-Time Scaling (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated exceptional performance in reasoning tasks, particularly in mathematics. |
| Approach: | They propose a dynamic self-consistency framework that integrates System 1 and System 2 reasoning to improve token efficiency and latency. |
| Outcome: | The proposed method outperforms existing methods, achieving up to 47% reduction in token consumption and 43% reduction in inference latency without significant performance loss. |
Efficient Latent Semantic Clustering for Scaling Test-Time Computation of LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for scaling test-time computation rely on external models that introduce substantial computational overhead and fail to capture context-aware semantics. |
| Approach: | They propose a method that leverages the generator LLM’s internal hidden states for clustering, eliminating the need for external models. |
| Outcome: | The proposed method improves the computational efficiency of test-time scaling while maintaining or exceeding the performance of existing methods. |
Reflective Decoding: Beyond Unidirectional Generation with Off-the-Shelf Language Models (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for generating text are unsupervised and require supervision. |
| Approach: | They propose an unsupervised method that uses two off-the-shelf pretrained LMs in opposite directions to apply them to non-sequential tasks. |
| Outcome: | The proposed method outperforms strong unsupervised baselines on paraphrasing and abductive text infilling. |