Challenge: Existing approaches to train large-scale models with extensive datasets are limited by their inadequate planning capabilities compared to humans.
Approach: They propose a paradigm that enhances the performance of Large Language Models (LLMs) they use look-ahead planning to refine action selection and LEAN to streamline navigation through agile prompt construction.
Outcome: The proposed framework outperforms agents trained via imitation learning, reinforcement learning, and reasoning-based approaches without any fine-tuning.

Similar Papers

MAXS: Meta-Adaptive Exploration with LLM Agents (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for inference are often myopic and have divergent reasoning paths . a meta-adaptive reasoning framework is proposed to improve the efficiency of LLM agents .
Approach: They propose a meta-adaptive reasoning framework that integrates tool execution and reasoning planning.
Outcome: The proposed framework outperforms existing methods in performance and inference efficiency.
Unlocking the Future: Exploring Look-Ahead Planning Mechanistic Interpretability in Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Recent studies have shown that large language models may possess preliminary planning capabilities.
Approach: They examine the look-ahead planning mechanism in large language models from the perspectives of information flow and internal representations.
Outcome: The proposed model can decode the decision from the output of MHSA in the middle layers at the last token.
Small LLMs Are Weak Tool Learners: A Multi-LLM Agent (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have revolutionized natural language processing with impressive capabilities, but they lack domain specificity, real-time information and face challenges in solving specialized problems.
Approach: They propose a multi-LLM approach that decomposes the aforementioned capabilities into a planner, caller, and summarizer.
Outcome: The proposed model outperforms existing models by demonstrating its effectiveness and advantages in tool learning.
Runaway is Ashamed, But Helpful: On the Early-Exit Behavior of Large Language Model-based Agents in Embodied Environments (2025.findings-emnlp)

Copied to clipboard

Challenge: Experiments with 4 different LLMs across 5 embodied environments show significant efficiency improvements, with only minor drops in agent performance.
Approach: They propose an intrinsic method that injects exit instructions during generation and an extransic system that verifies task completion to determine when to halt an agent’s trial.
Outcome: The proposed method injects exit instructions during generation and an exit method verifies task completion to determine when to halt an agent’s trial.
A Review of Prominent Paradigms for LLM-Based Agents: Tool Use, Planning (Including RAG), and Feedback Learning (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models have been used for planning, tool use, and feedback learning . inconsistent taxonomy and complexity of workflows create challenges .
Approach: They propose a unified taxonomy to review and discuss the three paradigms . they define environments/tasks, common LLM-profiled roles and universally applicable workflows based on prior work .
Outcome: The proposed taxonomy compares LMPR implementations and workflow usage across paradigms . large language models have human-like reasoning capabilities, the authors say .
Prospector: Improving LLM Agents with Self-Asking and Trajectory Ranking (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing LLMs are limited in their ability to incorporate feedback from an environment.
Approach: They propose an LLM agent that consists of an Actor and a Critic.
Outcome: The proposed agent outperforms existing LLMs on benchmark environments and shows that it can generate diverse trajectories and pick the most rewarding trajectory.
What Makes an LLM a Good Optimizer? A Trajectory Analysis of LLM-Guided Evolutionary Search (2026.findings-acl)

Copied to clipboard

Challenge: Recent work has demonstrated the promise of orchestrating large language models (LLMs) within evolutionary and agentic optimization systems.
Approach: They present a large-scale study of LLM-guided evolutionary search . they find strong LLMs behave as local refiners, producing frequent improvements . weaker LLM optimizers exhibit large semantic drift, they say .
Outcome: The results highlight the importance of trajectory analysis for understanding and improving LLM-based optimization systems.
LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planning (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing path planning algorithms suffer from significant computational and memory inefficiencies as the state space grows . large language models excel in environmental analysis but fall short in detailed spatial and temporal reasoning .
Approach: They propose a new path planning method that synergistically combines A* and LLMs to improve pathfinding efficiency.
Outcome: The proposed method improves pathfinding efficiency while maintaining integrity of path validity in large-scale scenarios.
Towards Efficient LLM Grounding for Embodied Multi-Agent Collaboration (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for grounding large language models suffer from inefficient querying . Existing approaches that rely on physical verification or self-reflection suffer from excessive querying.
Approach: They propose a framework that introduces Reinforced Advantage feedback for efficient self-refinement of plans.
Outcome: The proposed framework surpasses baselines in success rate and significantly decreases interaction steps of agents and query rounds of LLMs.
Learning to Use Tools via Cooperative and Interactive Agents (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for large language models (LLMs) use one agent to iterate and execute tools, but they suffer from performance degradation when addressing practical tasks.
Approach: They propose a tool learning framework that coordinates three specialized agents for tool selection, tool execution, and action calibration separately.
Outcome: The proposed framework outperforms baseline models on three datasets with 14% higher success rate.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations