| Challenge: | Developing intelligent agents requires the ability to produce plans on the fly based on visual observations. |
| Approach: | They propose a language-first procedure planning framework with a modularized design . they first align current and goal observations with corresponding steps and then use a pre-trained LM to predict intermediate steps. |
| Outcome: | The proposed framework matches state-of-the-art procedures on COIN and CrossTask benchmarks. |
Similar Papers
A Picture is Worth a Thousand Words: Language Models Plan from Pixels (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent work uses pre-trained language models to reason about plans from text instructions in embodied visual environments. |
| Approach: | They propose to use pre-trained language models to reason about plan sequences from text instructions in embodied visual environments. |
| Outcome: | The proposed approach outperforms previous approaches on the ALFWorld and VirtualHome benchmarks. |
Unlocking the Future: Exploring Look-Ahead Planning Mechanistic Interpretability in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown that large language models may possess preliminary planning capabilities. |
| Approach: | They examine the look-ahead planning mechanism in large language models from the perspectives of information flow and internal representations. |
| Outcome: | The proposed model can decode the decision from the output of MHSA in the middle layers at the last token. |
Creative Planning with Language Models: Practice, Evaluation and Applications (2025.naacl-tutorial)
Copied to clipboard
| Challenge: | This tutorial explores how planning has been learned and deployed in creative workflows . many human creative tasks involve extensive planning, and actions need to be taken . |
| Approach: | This tutorial explores how planning has been learned and deployed in creative workflows . authors discuss forward and backward learning approaches for planning in LLMs - and evaluation metrics tailored to latent plans . |
| Outcome: | This tutorial examines how planning has been learned and deployed in creative workflows . it discusses forward and backward learning approaches for planning in LLMs - evaluation metrics tailored to latent plans . |
LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models excel in various natural language tasks but struggle with long-horizon planning problems requiring structured reasoning. |
| Approach: | They propose to integrate large language models into AP and NLP planning frameworks by reviewing current research and identifying critical challenges and future directions. |
| Outcome: | The proposed frameworks are used to support reliable off-the-shelf AP planners. |
Beyond English: The Impact of Prompt Translation Strategies across Languages and Tasks in Multilingual LLMs (2025.findings-naacl)
Copied to clipboard
| Challenge: | Current LLMs are primarily trained on English data but also include data from other languages. |
| Approach: | They propose to use a pre-translation strategy to translate a task prompt into English before inference . they use 'a modular entity' that could be translated into four different languages . |
| Outcome: | The proposed strategies are based on a set of pre-trained data across 35 languages covering both low and high-resource languages. |
Unifying Inference-Time Planning Language Generation (2026.findings-acl)
Copied to clipboard
Prabhu Prakash Kagitha, Bo Sun, Ishan Desai, Andrew Zhu, Cassie Huang, Manling Li, Ziyang Li, Li Zhang
| Challenge: | Large language models (LLMs) are used to generate a formal representation of a plan in a planning language. |
| Approach: | They propose a unifying organizational framework based on intermediate representations to unify the inference-time LLM-as-formalizer methodology for classical planning. |
| Outcome: | The proposed framework subsumes most existing work and proposes new ones that involve syntactically similar but high-resource intermediate languages. |
Few-shot Subgoal Planning with Language Models (2022.naacl-main)
Copied to clipboard
| Challenge: | Pre-trained language models have shown successful progress in many text understanding benchmarks. |
| Approach: | They propose a strategy to re-rank language model predictions based on interaction and feedback from the environment. |
| Outcome: | The proposed approach shows competitive performance on subgoal prediction and task completion in the ALFRED benchmark compared to prior methods that assume more subgoals supervision. |
Language Model as Planner and Formalizer under Constraints (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been widely used in planning but lack interpretability and control. |
| Approach: | They propose to augment widely used planning benchmarks with manually annotated, fine-grained, and rich natural language constraints spanning four formally defined categories. |
| Outcome: | The proposed model outperforms existing models in 4 state-of-the-art reasoning LLMs, 4 formal languages, and 4 datasets. |
Explicit Planning Helps Language Models in Logical Reasoning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems that use pre-trained large language models to perform multi-step logical reasoning have been unable to perform this task. |
| Approach: | They propose a system that uses language models to perform multi-step logical reasoning and incorporates explicit planning into the inference procedure. |
| Outcome: | The proposed system outperforms other competing methods on multiple datasets and significantly outperformed chain-of-thought prompting on the PrOntoQA dataset. |
Reasoning with Language Model is Planning with World Model (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown remarkable reasoning capabilities, particularly with Chain-of-Thought-style prompts. |
| Approach: | They propose a framework that repurposes the LLM as both a world model and a reasoning agent and incorporates a principled planning algorithm (based on Monte Carlo Tree Search) |
| Outcome: | The proposed framework repurposes the LLM as both a world model and a reasoning agent and incorporates a principled planning algorithm (based on Monte Carlo Tree Search) it achieves optimum balance between exploration and exploitation, while achieving high-reward reasoning paths efficiently. |