Inductive-Deductive Strategy Reuse for Multi-Turn Instructional Dialogues (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods target instruction dialogues as learning goal and fine-tune user simulators to pose instructions. |
| Approach: | They propose to use real instruction dialogues to model complex dialogue flows and pose high-quality instructions. |
| Outcome: | The proposed method generates diverse, in-depth, and insightful instructions for a given dialogue history. |
Similar Papers
Strategy-Induct: Task-Level Strategy Induction for Instruction Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for task-level instruction generation rely on input-output pairs . obtaining labeled answers can be difficult or costly, limiting generalization across architectures. |
| Approach: | They propose a framework that derives task-level instructions solely from a small set of example questions without requiring labeled answers. |
| Outcome: | The proposed framework outperforms state-of-the-art methods in question-only settings. |
Can Language Models Follow Multiple Turns of Entangled Instructions? (2025.findings-emnlp)
Copied to clipboard
Chi Han, Xin Liu, Haodong Wang, Shiyang Li, Jingfeng Yang, Haoming Jiang, Zhengyang Wang, Qingyu Yin, Liang Qiu, Changlong Yu, Yifan Gao, Zheng Li, Bing Yin, Jingbo Shang, Heng Ji
| Challenge: | Despite of significant achievements in improving instruction-following capabilities of large language models, the ability to process multiple potentially entangled or conflicting instructions remains a considerable challenge. |
| Approach: | They construct multi-turn instruction with 1.1K high-quality multi-turned conversations using the human-in-the-loop approach and examine their capabilities. |
| Outcome: | The proposed model shows that it is difficult to integrate multiple turns and balance competing objectives when instructions intersect or conflict. |
One Battle After Another: Probing LLMs’ Limits on Multi-Turn Instruction Following with a Benchmark Evolving Framework (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for instruction-following in multi-topic dialogues are limited to a fixed number of turns, susceptible to saturation and failing to account for users’ interactive experience. |
| Approach: | They propose a framework featuring a three-layer tracking mechanism and a query synthesis agent to mimic sequential user behaviors. |
| Outcome: | The proposed framework outperforms existing benchmarks in the evaluation of instruction following in multi-topic dialogues and demonstrates deficiencies in failure recovery and fine-grained instruction following. |
ConsistentChat: Building Skeleton-Guided Consistent Multi-Turn Dialogues for Large Language Models from Scratch (2025.emnlp-main)
Copied to clipboard
Jiawei Chen, Xinyan Guan, Qianhao Yuan, Mo Guozhao, Weixiang Zhou, Yaojie Lu, Hongyu Lin, Ben He, Le Sun, Xianpei Han
| Challenge: | Existing instruction data synthesis methods focus on single-turn instructions and neglect cross-turn coherence, resulting in context drift and reduced task completion rates. |
| Approach: | They propose a framework that constrains multi-turn instruction synthesis by explicitly modeling human conversational intent. |
| Outcome: | The proposed framework outperforms existing models trained on single-turn and multi-turn instruction datasets. |
RefGPT: Dialogue Generation of GPT, by GPT, and for GPT (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have impressive capability to resolve a wide range of NLP tasks by fine-tuning high-quality instruction data. |
| Approach: | They propose a method to generate huge truthful and customized dialogues without worrying about factual errors caused by the model hallucination. |
| Outcome: | The proposed method solves the model hallucination in dialogue generation by restricting the LLMs to leverage the given reference instead of reciting their own knowledge to generate dialogues. |
Demystifying Instruction Mixing for Fine-tuning Large Language Models (2024.acl-srw)
Copied to clipboard
| Challenge: | Instruction tuning is effective for aligning large language models with human instructions, but the procedure to optimizing the mixing of instruction datasets is still unclear. |
| Approach: | They categorize instructions into three primary types: NLP downstream tasks, coding, and general chat. |
| Outcome: | The proposed method improves performance of large language models (LLMs) but it is difficult to combine different instruction datasets to optimize overall performance. |
“In-Dialogues We Learn”: Towards Personalized Dialogue Without Pre-defined Profiles through In-Dialogue Learning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to personalized dialogue generate pre-defined profiles that are time-consuming and labor-intensive to create. |
| Approach: | They propose a framework that leverages dialogue history to characterize personas without pre-defined profiles. |
| Outcome: | The proposed framework improves BLEU and ROUGE scores on three datasets and human evaluations further validate the proposed method. |
Unlocking Speech Instruction Data Potential with Query Rewriting (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing LLMs lack datasets and biased training tasks to follow speech instructions. |
| Approach: | They propose a query rewriting framework that uses multiple agents to annotate and validate the synthesized speech. |
| Outcome: | The proposed framework can transform text instructions into distributions more suitable for TTS models for speech synthesis without human annotation. |
Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents (2023.emnlp-main)
Copied to clipboard
Hyungjoo Chae, Yongho Song, Kai Ong, Taeyoon Kwon, Minjin Kim, Youngjae Yu, Dongha Lee, Dongyeop Kang, Jinyoung Yeo
| Challenge: | a human-like chatbot requires commonsense reasoning to comprehend and respond to information . however, identifying and aggregating key evidence within a single hop is a challenge . a knowledge distillation framework is proposed that leverages LLMs as unreliable teachers . |
| Approach: | They propose a framework that leverages large language models as unreliable teachers to facilitate multi-hop reasoning over a dialogue context. |
| Outcome: | The proposed framework leverages LLMs as unreliable teachers and selectively distills consistent and helpful rationales via alignment filters. |
From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) follow instructions with elaborate requirements, yet it remains under-explored how to enhance their ability to follow complex instructions with multiple constraints. |
| Approach: | They propose a method to obtain and utilize effective training data to enhance LLMs' ability to follow complex instructions with multiple constraints. |
| Outcome: | The proposed framework improves models' ability to follow instructions generally and generalize effectively across out-of-domain, in domain, and adversarial settings while maintaining general capabilities. |