Papers with Self-reflection
Instruct-of-Reflection: Enhancing Large Language Models Iterative Reflection Capabilities via Dynamic-Meta Instruction (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches involve models iterating and improving their previous responses based on internal reflection ability or external feedback. |
| Approach: | They propose a reflection framework that leverages meta-thoughts and self-consistency to enhance the iterative reflection capability of Large LanguageModels. |
| Outcome: | The proposed framework achieves an average improvement of 10.1% over established baselines in mathematical and commonsense reasoning tasks, highlighting its efficacy and applicability. |
Entrospect: Information-Theoretic Self-Reflection Elicits Better Response Refinement of Small Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to self-reflection fail to deliver robust response refinement for models with parameter sizes of 10 billion or smaller. |
| Approach: | They propose to redesign Self-Refine and introduce an information-theoretic framework based on Chain-of-Thought prompt engineering to improve self-reflection in Small Language Models. |
| Outcome: | The proposed framework improves reasoning accuracy and computational efficiency by up to 36.2% under identical model and data settings. |