RETAIL: Towards Real-world Travel Planning for Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing travel planning systems assume users provide explicit queries, limiting their practical utility. |
| Approach: | They propose a dataset RETAIL which supports decision-making for implicit queries while covering explicit queries. |
| Outcome: | The proposed model achieves a 1.0% pass rate, suggesting real-world travel planning remains challenging. |
Similar Papers
Personal Large Language Model Agents: A Case Study on Tailored Travel Planning (2024.emnlp-industry)
Copied to clipboard
Harmanpreet Singh, Nikhil Verma, Yixiao Wang, Manasa Bharadwaj, Homa Fashandi, Kevin Ferreira, Chul Lee
| Challenge: | Large Language Models (LLMs) are becoming more autonomous and capable of handling real-world tasks through their access to tools, various planning strategies, and memory, referred to as LLM agents. |
| Approach: | They introduce a personalized version of TravelPlanner and establish baselines for personal LLM agents by comparing generic and personal plans. |
| Outcome: | The proposed model encapsulates user-related information, preferences, and personal concepts and provides baselines for personal LLM agents. |
TripTailor: A Real-World Benchmark for Personalized Travel Planning (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation metrics for travel planning rely on unrealistic simulated data . fewer than 10% of the itineraries generated by the latest state-of-the-art LLMs achieve human-level performance. |
| Approach: | They propose a benchmark for personalized travel planning in real-world scenarios . they identify several critical challenges in travel planning including feasibility and rationality . |
| Outcome: | The proposed benchmarks show that fewer than 10% of the itineraries generated by the latest state-of-the-art LLMs achieve human-level performance. |
LRPLAN: A Multi-Agent Collaboration of Large Language and Reasoning Models for Planning with Implicit & Explicit Constraints (2025.findings-emnlp)
Copied to clipboard
| Challenge: | LRPlan is a language-based multi-agent system for complex planning problems . large language models are often unable to maintain consistency across the planning process . |
| Approach: | They propose a language-based multi-agent architecture where LLM and LRM agents collaborate at training time to abstract important patterns, heuristics and insights about the domain. |
| Outcome: | The proposed language-based multi-agent architecture outperforms existing models and makes it publicly available. |
TP-RAG: Benchmarking Retrieval-Augmented Large Language Model Agents for Spatiotemporal-Aware Travel Planning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on large language models (LLMs) focus on basic plan validity, but neglect critical aspects such as route efficiency, POI appeal, and real-time adaptability. |
| Approach: | They propose a benchmark for retrieval-augmented, spatiotemporal-aware travel planning that integrates retrieved trajectories with LLMs’ intrinsic reasoning. |
| Outcome: | The proposed framework improves spatial efficiency and POI rationality while challenging universality and robustness due to conflicting references and noisy data. |
Can LLMs Truly Plan? A Comprehensive Evaluation of Planning Capabilities (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing assessments of planning capabilities of large language models are limited to single-language or specific representation formats. |
| Approach: | a new benchmark is developed to assess the planning capabilities of large language models. |
| Outcome: | The Multi-Plan benchmark highlights performance disparities among models . language differences showed minimal impact, while mathematically structured representations improved accuracy . |
Large Language Models Can Solve Real-World Planning Rigorously with Formal Verification Tools (2025.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) struggle to generate correct plans for multi-constraint planning problems . a recent study showed that large language models have significant potential in solving planning problems. |
| Approach: | They propose an LLM-based planning framework that formalizes and solves multi-constraint planning problems as constrained satisfiability problems. |
| Outcome: | The proposed framework achieves a success rate of 93.9% and is effective with diverse paraphrased prompts. |
Beyond Itinerary Planning—A Real-World Benchmark for Multi-Turn and Tool-Using Travel Tasks (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on LLM performance on travel planning have shown that existing settings are limited due to limited domain coverage, insufficient modeling of users’ implicit preferences in multi-turn conversations, and a lack of evaluation of agents’ capability boundaries. |
| Approach: | They propose a benchmark to evaluate LLMs' planning and tool-use abilities in real-world settings by collecting user queries, user preferences, and tools from real scenarios. |
| Outcome: | The proposed benchmark evaluates agents' capabilities in real-world settings and shows that even advanced models exhibit imbalanced performance across different capabilities. |
UrbanLLM: Autonomous Urban Activity Planning and Management with Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | UrbanLLM is a fine-tuned large language model designed to tackle diverse urban problems. |
| Approach: | They propose a fine-tuned large language model to tackle diverse urban problems . UrbanLLM decomposes urban-related queries into manageable sub-tasks . |
| Outcome: | The proposed model outperforms existing models in urban planning and management tasks. |
LLMAP: LLM-Assisted Multi-Objective Route Planning with User Preferences (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that large language models (LLMs) are limited in understanding natural language preferences. |
| Approach: | They propose a novel LLM-as-Parser-based route planning system that utilizes an LLM to comprehend natural language, extract user preferences and recognize task dependencies. |
| Outcome: | The proposed system achieves superior performance with guarantees across multiple constraints. |
Little Red Riding Hood Goes around the Globe: Crosslingual Story Planning and Generation with Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing work has demonstrated the effectiveness of planning for story generation exclusively in a monolingual setting focusing primarily on English. |
| Approach: | They propose a task of crosslingual story generation with planning to leverage the creative and reasoning capabilities of large pretrained language models to generate stories in multiple languages. |
| Outcome: | The proposed task combines planning and planning in a monolingual setting and demonstrates that plans which structure stories into three acts lead to more coherent and interesting narratives while allowing to explicitly control their content and structure. |