Challenge: Modern AI agents rely on Large Language Models (LLMs) as their reasoning engines, but they still face the challenge of generating meaningful reflections due to inadequate error analysis and a reliance on rare successful trajectories.
Approach: They propose a framework for self-learning agents powered by a retrospective language model that generates reflections during inference.
Outcome: The proposed framework outperforms reflection-based baselines on three challenging benchmarks.

Similar Papers

Towards Self-Improving Error Diagnosis in Multi-Agent Systems (2026.findings-acl)

Copied to clipboard

Challenge: Existing diagnostic approaches rely on expensive expert annotations and ”LLM-as-a-judge” paradigms.
Approach: They propose a framework for semantic failure attribution that identifies responsible agents and the originating error step.
Outcome: The proposed framework outperforms baselines in step-level localization and validation.
Failure makes the agent stronger: Enhancing Accuracy through Structured Reflection for Reliable Tool Interactions (2026.findings-acl)

Copied to clipboard

Challenge: Existing approaches to self-reflection rely on heuristic prompting or unidirectional reasoning traces.
Approach: They propose a structured reflection method that transforms the "from error to repair" process into a first-class, controllable, and trainable action.
Outcome: The proposed method improves multi-turn tool-call success rates and error recovery while reducing redundant calls.
Learn Like Humans: Use Meta-cognitive Reflection for Efficient Self-Improvement (2026.acl-long)

Copied to clipboard

Challenge: Existing self-improving frameworks rely on inefficient, multi-turn recursive loops that incur high computational costs.
Approach: They propose a framework that achieves efficient self-evolution within a single recurrence cycle.
Outcome: The proposed framework outperforms state-of-the-art self-evolving systems while significantly reducing computational overhead.
STeCa: Step-level Trajectory Calibration for LLM Agent Learning (2025.findings-acl)

Copied to clipboard

Challenge: Existing work focuses on behavior cloning from expert demonstrations or preference learning through exploratory trajectory sampling, but these methods often struggle to address long-horizon tasks where suboptimal actions accumulate step by step, causing agents to deviate from correct task trajectories.
Approach: They propose a framework for LLM-based agent learning that identifies suboptimal actions through a step-level reward comparison during exploration and constructs calibrated trajectories using LLM reflection.
Outcome: The proposed framework outperforms existing methods in long-horizon tasks where suboptimal actions accumulate step by step, causing agents to deviate from correct task trajectories.
Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimization (2024.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are designed as specific task solvers with sophisticated prompt engineering, but are inherently incapacitating to address complex dynamic scenarios.
Approach: They propose an LLM-based agent with policy-level reflection and optimization that can learn from interactive experiences and progressively elevate its behavioral policy.
Outcome: The proposed agent outperforms vanilla LLM and specialized models in blackjack and Texas hold’em.
Re-ReST: Reflection-Reinforced Self-Training for Language Agents (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to fine tune language agents with reasoning-action trajectories require high-quality model-generated samples, which are hard to obtain for challenging language agent tasks.
Approach: They propose a method to employ reflection during inference without ground-truth feedback to improve agents more autonomously.
Outcome: The proposed method improves self-training performance on open-source language agents by 7.6% and 14.1% respectively.
Metacognitive Self-Correction for Multi-Agent System via Prototype-Guided Next-Execution Reconstruction (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Model based multi-agent systems (MAS) excel at collaborative problem solving but remain brittle to cascading errors.
Approach: They propose a metacognitive framework that enables step-level error detection and self-correction in Large Language Model based multi-agent systems (MAS) .
Outcome: The proposed framework outperforms baselines on the Who When benchmark and delivers consistent gains on AgentErrorBench.
DUAL-REFLECT: Enhancing Large Language Models for Reflective Translation through Dual Learning Feedback Mechanisms (2024.acl-short)

Copied to clipboard

Challenge: Existing self-reflection methods lack effective feedback information, limiting the translation performance of large language models (LLMs).
Approach: They propose a framework that leverages the dual learning of translation tasks to provide effective feedback, thereby enhancing the models’ self-reflective abilities and improving translation performance.
Outcome: The proposed framework improves the models’ self-reflective abilities and improves translation accuracy and eliminating ambiguities across translation tasks.
Instruct-of-Reflection: Enhancing Large Language Models Iterative Reflection Capabilities via Dynamic-Meta Instruction (2025.naacl-long)

Copied to clipboard

Challenge: Existing approaches involve models iterating and improving their previous responses based on internal reflection ability or external feedback.
Approach: They propose a reflection framework that leverages meta-thoughts and self-consistency to enhance the iterative reflection capability of Large LanguageModels.
Outcome: The proposed framework achieves an average improvement of 10.1% over established baselines in mathematical and commonsense reasoning tasks, highlighting its efficacy and applicability.
AgentGym: Evaluating and Training Large Language Model-based Agents across Diverse Environments (2025.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are promising foundations to build generally-capable agents . however, the community lacks a unified interactive framework that covers diverse environments for comprehensive evaluation of agents.
Approach: They propose a framework that features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction.
Outcome: The proposed framework features 7 real-world scenarios, 14 environments, and 89 tasks for unified, real-time, and concurrent agent interaction.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations