A Goal Without a Plan Is Just a Wish: Efficient and Effective Global Planner Training for Long-Horizon Agent Tasks (2026.acl-long)
Copied to clipboard
Shuzheng Si, Haozhe Zhao, Kangyang Luo, Gang Chen, Fanchao Qi, Minjia Zhang, Baobao Chang, Maosong Sun
| Challenge: | Recent advances in large language models (LLMs) have leapt from static chatbots to versatile agents that tackle complex tasks such as science experiments. |
| Approach: | They propose a plan-and-execute framework and propose 'EAGLET' to enhance the executor agent's planning abilities without human effort. |
| Outcome: | The proposed method outperforms existing methods on three long-horizon tasks and reduces training costs by 8 compared to baselines. |
Similar Papers
Encouraging Good Processes Without the Need for Good Answers: Reinforcement Learning for LLM Agent Planning (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Currently, the dominant end-to-end reinforcement learning paradigm for agents in Large Language Models (LLMs) employs multi-objective optimization that jointly trains both planning and answer summarization capabilities. |
| Approach: | They propose a framework that decouples the training process to enable a focused, single-objective optimization of the planning module. |
| Outcome: | The proposed framework achieves an 8%–12% improvement in planning performance compared to end-to-end baselines. |
RaDA: Retrieval-augmented Web Agent Planning with LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Agents powered by large language models inherit important limitations such as the restricted context length, dependency on human-engineered exemplars, and insufficient generalization. |
| Approach: | They propose a novel planning method for Web agents that disentangles planning into two stages: for a new given task, it decomposes tasks into high-level subtasks; and then iteratively synthesizes actions based on dynamically retrieved exemplars. |
| Outcome: | The proposed method decomposes tasks into high-level subtasks and iteratively synthesizes actions based on dynamically retrieved exemplars. |
DeepPlanner: Scaling Planning Capability for Deep Research Agents via Advantage Shaping (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to planning involve implicit planning or introduce explicit planners without systematically optimizing the planning stage. |
| Approach: | They propose an end-to-end RL framework that enhances the planning capabilities of deep research agents. |
| Outcome: | Experiments show that DeepPlanner improves planning quality and achieves state-of-the-art results under a lower training budget. |
Small LLMs Are Weak Tool Learners: A Multi-LLM Agent (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have revolutionized natural language processing with impressive capabilities, but they lack domain specificity, real-time information and face challenges in solving specialized problems. |
| Approach: | They propose a multi-LLM approach that decomposes the aforementioned capabilities into a planner, caller, and summarizer. |
| Outcome: | The proposed model outperforms existing models by demonstrating its effectiveness and advantages in tool learning. |
ToolCPT: Improving Tool Utilization in LLM Agents via Continuous Pre-training (2026.findings-acl)
Copied to clipboard
| Challenge: | Current approaches to enhancing tool use for LLM-based agents focus on post-training fine-tuning or test-time context extension. |
| Approach: | They propose to enhance tool knowledge for LLM-based agents during continuous pre-training . they curate 5.1 million code artifacts from large-scale, high-quality code repositories . |
| Outcome: | The proposed model outperforms existing methods on out-of-distribution tools on multiple benchmarks. |
SGA-MCTS: Decoupling Planning from Execution via Training-Free Atomic Experience Retrieval (2026.findings-acl)
Copied to clipboard
| Challenge: | a new framework casts LLM planning as non-parametric retrieval, but high latency of inference-time search and supervised fine-tuning are limitations. |
| Approach: | They propose a framework that casts LLM planning as non-parametric retrieval . they leverage Monte Carlo Tree Search to explore the solution space . |
| Outcome: | Empirical results show that SGA-MCTS can match the performance of SOTA systems without task-specific fine-tuning. |
D2Plan: Dual-Agent Dynamic Global Planning for Complex Retrieval-Augmented Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in reinforcement learning (RL) have empowered Large Language Models (LLMs) with the capability to perform autonomous retrieval during reasoning tasks. |
| Approach: | They propose a "D2Plan" paradigm for retrieval-augmented reasoning that integrates a 'Reasoner' and a'Purifier' |
| Outcome: | Experiments show that the proposed paradigm improves on QA benchmarks. |
KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents (2025.findings-naacl)
Copied to clipboard
Yuqi Zhu, Shuofei Qiao, Yixin Ou, Shumin Deng, Shiwei Lyu, Yue Shen, Lei Liang, Jinjie Gu, Huajun Chen, Ningyu Zhang
| Challenge: | Large Language Models (LLMs) fail to effectively guide the planning trajectories during task solving and result in planning hallucinations. |
| Approach: | They propose a novel approach to enhance the planning capabilities of large language models by incorporating explicit action knowledge. |
| Outcome: | The proposed approach can achieve comparable or superior performance to existing baselines on HotpotQA and ALFWorld. |
DeepPlanning: Benchmarking Long-Horizon Agentic Planning with Verifiable Constraints (2026.acl-long)
Copied to clipboard
Yinger Zhang, Shutong Jiang, Renhao Li, Jianhong Tu, Yang Su, Lianghao Deng, Xudong Guo, ChenXu Lv, Junyang Lin
| Challenge: | Existing LLM planning benchmarks emphasize local, step-level reasoning rather than global constrained optimization. |
| Approach: | They propose a benchmark for practical long-horizon agent planning that uses local constrained reasoning and global constrained optimization. |
| Outcome: | The proposed benchmarks show that even frontier agentic LLMs struggle with these problems. |
Teaching LLMs to Plan, Not Just Solve: Plan Learning Boosts LLMs Generalization in Reasoning Tasks (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for reinforcement learning (RL) on self-generated data are limited in many domains. |
| Approach: | a new framework combines plan-based search with Step-level Advantage Preference Optimization to optimize plan learning. |
| Outcome: | The proposed framework improves in-domain performance and out-of-domain benchmarks. |