Failure makes the agent stronger: Enhancing Accuracy through Structured Reflection for Reliable Tool Interactions (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to self-reflection rely on heuristic prompting or unidirectional reasoning traces. |
| Approach: | They propose a structured reflection method that transforms the "from error to repair" process into a first-class, controllable, and trainable action. |
| Outcome: | The proposed method improves multi-turn tool-call success rates and error recovery while reducing redundant calls. |
Similar Papers
Robust Tool Use via Fission-GRPO: Learning to Recover from Execution Errors (2026.acl-long)
Copied to clipboard
Zhiwei Zhang, Fei Zhao, Rui Wang, Zezhong Wang, Bin Liang, Jiakang Wang, Yao Hu, Shaosheng Cao, Kam-Fai Wong
| Challenge: | Large language models (LLMs) can call tools effectively, but they remain brittle in multi-turn execution. |
| Approach: | They propose a framework that converts execution errors into on-policy corrective supervision within the RL training loop. |
| Outcome: | The proposed framework improves the error recovery rate of Qwen3-8B by 5.7% absolute and overall accuracy by 4.0% on BFCL v4 Multi-Turn. |
Do LLMs Catch Their Own Mistakes? A Comprehensive Benchmark for Reflective Tool Use LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks primarily evaluate planning and execution success, overlooking the self-reflective dimension of tool use. |
| Approach: | They propose a benchmark to assess LLMs’ self-reflective reasoning in tool-augmented multi-turn dialogues. |
| Outcome: | The proposed benchmark covers 10 domains with 88 distinct APIs and 968 annotated dialogues, systematically injecting diverse error types arising from both user and assistant behavior. |
SAMULE: Self-Learning Agents Enhanced by Multi-level Reflection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Modern AI agents rely on Large Language Models (LLMs) as their reasoning engines, but they still face the challenge of generating meaningful reflections due to inadequate error analysis and a reliance on rare successful trajectories. |
| Approach: | They propose a framework for self-learning agents powered by a retrospective language model that generates reflections during inference. |
| Outcome: | The proposed framework outperforms reflection-based baselines on three challenging benchmarks. |
ReflecTool: Towards Reflection-Aware Tool-Augmented Clinical Agents (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown promising potential in the medical domain, assisting with tasks like clinical note generation and patient communication. |
| Approach: | They propose a framework that excels at utilizing domain-specific tools within two stages. |
| Outcome: | The proposed framework surpasses the pure LLMs with more than 10 points and the well-established agent-based methods with 3 points. |
A Joint Optimization Framework for Enhancing Efficiency of Tool Utilization in LLM Agents (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing efforts for tool utilization involve an LLM agent that contains instructions on using the description of the available tools to determine and call the tools required to solve the problem. |
| Approach: | They propose to optimize the context of LLM agents by combining the instructions provided in agent prompts and tool descriptions to enhance their interaction. |
| Outcome: | The proposed framework improves both the instructions provided in agent prompt and tool description, enhancing their interaction. |
JTPRO: A Joint Tool–Prompt Reflective Optimization Framework for Language Agents (2026.findings-acl)
Copied to clipboard
Sandip Ghoshal, Anshul Mittal, Jyotika Singh, Miguel Ballesteros, Weiyi Sun, Fang Tu, Shailender Singh, Yassine Benajiba, Fahad Shah, Sujeeth Bharadwaj, Sujith Ravi, Dan Roth
| Challenge: | Large language model agents struggle with ambiguous tool descriptions and underspecified tool schemas that ignore tool-specific nuances. |
| Approach: | They propose a framework for improving tool-calling reliability in trace-supervised settings by rolling out-driven reflection. |
| Outcome: | The proposed framework outperforms baselines and reflective prompt optimizers by 5%–20% on OSR. |
Lost in Execution: On the Multilingual Robustness of Tool Calling in Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly deployed as agents that invoke external tools through structured function calls. |
| Approach: | They introduce a diagnostic benchmark and conduct a systematic evaluation of multilingual tool calling across Chinese, Hindi, and the low-resource language Igbo. |
| Outcome: | The proposed benchmarks show that multilingual tool calling fails despite correct intent understanding and tool selection. |
The Confidence Dichotomy: Analyzing and Mitigating Miscalibration in Tool-Use Agents (2026.acl-long)
Copied to clipboard
| Challenge: | a fundamental pillar of trustworthiness is calibration, which refers to an agent’s ability to express confidence that reliably reflects its actual performance. |
| Approach: | They propose a reinforcement learning framework that jointly optimizes task accuracy and calibration, supported by a holistic benchmark of reward designs. |
| Outcome: | The proposed framework improves calibration across tool types and shows that trained agents achieve superior calibration and exhibit robust generalization from local training environments to noisy web settings and to distinct domains such as mathematical reasoning. |
Assertion-Conditioned Compliance: A Provenance-Aware Vulnerability in Multi-Turn Tool-Calling Agents (2026.eacl-industry)
Copied to clipboard
| Challenge: | Multi-turn tool-calling models have emerged as a key feature in modern AI assistants, but their success in safety-critical industries remains constrained by concerns about transparency and model resilience. |
| Approach: | They propose a new evaluation paradigm for multi-turn function-calling LLMs that provides holistic metrics that evaluate a model’s behavior when confronted with misleading assertions. |
| Outcome: | The proposed evaluation paradigm evaluates a model's behavior when confronted with misleading assertions originating from two distinct vectors: (1) user-sourced assertions (USAs) and (2) function-sourced assertions (FSAs). |
Feedback-Driven Tool-Use Improvements in Large Language Models via Automated Build Environments (2026.findings-acl)
Copied to clipboard
Junjie Ye, Changhao Jiang, Zhengyin Du, Yufei Xu, Xuesong Yao, Zhiheng Xi, Xiaoran Fan, Qi Zhang, Tao Gui, Xuanjing Huang, Jiecao Chen
| Challenge: | Currently, there are no efficient reinforcement learning (RL) frameworks specifically designed for tool use. |
| Approach: | They propose an automated environment construction pipeline that incorporates scenario decomposition, document generation, function integration, complexity scaling, and localized deployment to enable high-quality training environments without external tools. |
| Outcome: | The proposed framework significantly improves the models’ tool-use performance without degrading their general capabilities. |