DuetSim: Building User Simulator with Dual Large Language Models for Task-Oriented Dialogues (2024.lrec-main)
Copied to clipboard
| Challenge: | User Simulators are used to train task-oriented dialogue systems . traditional training paradigms rely on human-engineered agendas resulting in generated responses that lack diversity and spontaneity. |
| Approach: | They propose a framework that leverages large language models to generate diverse responses . they use two LLMs to generate and verify responses, which are preferred by users . |
| Outcome: | The proposed framework produces responses that exhibit diversity and are preferred by human users. |
Similar Papers
Generative Interfaces for Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models are increasingly seen as assistants, copilots, and consultants . however, their linear request-response format often makes interactions inefficient in multi-turn tasks . |
| Approach: | They propose a paradigm in which large language models respond to user queries by generating user interfaces that enable more adaptive and interactive engagement. |
| Outcome: | The proposed paradigm outperforms traditional chat-based interfaces in many tasks and interaction patterns. |
DIALIGHT: Lightweight Multilingual Development and Evaluation of Task-Oriented Dialogue Systems with Large Language Models (2024.naacl-demo)
Copied to clipboard
| Challenge: | DIALIGHT is a toolkit for developing and evaluating multilingual Task-Oriented Dialogue systems. |
| Approach: | They propose a toolkit for developing and evaluating multilingual Task-Oriented Dialogue systems which facilitates systematic evaluations and comparisons between ToD systems using pretrained language models and those utilising the zero-shot and in-context learning capabilities of Large Language Models. |
| Outcome: | The toolkit enables systematic evaluations between ToD systems using pretrained language models and those utilising the zero-shot and in-context learning capabilities of Large Language Models (LLMs). |
Combining Discourse Coherence with Large Language Models for More Inclusive, Equitable, and Robust Task-Oriented Dialogue (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are capable of generating well-formed responses, but they struggle in goal-oriented settings. |
| Approach: | They propose a discourse-aware multimodal task-oriented dialogue system that combines discourse theories with offline LLM generation. |
| Outcome: | The proposed system reduces misunderstandings in the dialect of African-American Vernacular English from 93% to 57%. |
A Survey on LLM-based Conversational User Simulation (2026.eacl-long)
Copied to clipboard
Bo Ni, Yu Wang, Leyao Wang, Branislav Kveton, Franck Dernoncourt, Yu Xia, Hongjie Chen, Reuben Luera, Samyadeep Basu, Subhojyoti Mukherjee, Puneet Mathur, Nesreen K. Ahmed, Junda Wu, Li Li, Huixin Zhang, Ruiyi Zhang, Tong Yu, Sungchul Kim, Jiuxiang Gu, Zhengzhong Tu, Alexa Siu, Zichao Wang, Seunghyun Yoon, Nedim Lipka, Namyong Park, Zihao Lin, Trung Bui, Yue Zhao, Tyler Derr, Ryan A. Rossi
| Challenge: | Recent advances in large language models (LLMs) have enabled high-fidelity generation of synthetic user conversation. |
| Approach: | They propose a taxonomy covering user granularity and simulation objectives . they analyze core techniques and evaluation methodologies to help them understand the latest developments . |
| Outcome: | The proposed model enables high-fidelity generation of synthetic user conversation. |
Transferable Dialogue Systems and User Simulators (2021.acl-long)
Copied to clipboard
| Challenge: | a lack of training data is limiting the development of dialogue systems . we develop a framework for creating dialogue data through self-play between agents . |
| Approach: | They propose a framework that can incorporate new dialogue scenarios through self-play between two agents. |
| Outcome: | The proposed framework is highly effective in bootstrapping the performance of two agents in transfer learning. |
One Cannot Stand for Everyone! Leveraging Multiple User Simulators to train Task-oriented Dialogue Systems (2023.acl-long)
Copied to clipboard
| Challenge: | Recent studies have found that Task-oriented Dialogue systems can be more suitable for human users. |
| Approach: | They propose a framework to optimize ToD systems by leveraging Multiple User SimulaTors. |
| Outcome: | The proposed framework improves performance on multiWOZ with human evaluations and automatic evaluations. |
An Improved, Strong Baseline for Pre-Trained Large Language Models as Task-Oriented Dialogue Systems (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have shown that Large Language Models perform insufficiently as TOD systems. |
| Approach: | They propose a self-checking mechanism to improve LLM performance as TOD systems. |
| Outcome: | The proposed model outperforms existing models and improves their performance. |
Hello, It’s GPT-2 - How Can I Help You? Towards the Use of Pretrained Language Models for Task-Oriented Dialogue Systems (D19-56)
Copied to clipboard
| Challenge: | Statistical conversational systems are complex, timeintensive, expensive, and not easily transferable due to data scarcity. |
| Approach: | They propose a task-oriented dialogue model that operates on text input . they validate it on multi-domain task-orientated dialogues from a multi-word dataset . |
| Outcome: | The proposed model bypasses explicit policy and language generation modules on multi-domain task-oriented dialogues from the MultiWOZ dataset. |
Real or Robotic? Assessing Whether LLMs Accurately Simulate Qualities of Human Responses in Human-LLM Dialogue (2026.findings-acl)
Copied to clipboard
Jonathan Ivey, Shivani Kumar, Jiayu Liu, Hua Shen, Sushrita Rakshit, Rohan Raju, Haotian Zhang, Aparna Ananthasubramaniam, Junghwan Kim, Bowen Yi, Dustin Wright, Abraham Israeli, Anders Giovanni Møller, Lechen Zhang, David Jurgens
| Challenge: | Recent work has sought to use large language models to simulate human-human and human-LLM interactions. |
| Approach: | They use a large-scale dataset to generate a paired LLM-LLM and human-LLm dialogues from the WildChat dataset and quantify how well they align with their human counterparts. |
| Outcome: | The proposed models perform similarly in simulating English, Chinese, and Russian dialogues. |
DUAL-REFLECT: Enhancing Large Language Models for Reflective Translation through Dual Learning Feedback Mechanisms (2024.acl-short)
Copied to clipboard
| Challenge: | Existing self-reflection methods lack effective feedback information, limiting the translation performance of large language models (LLMs). |
| Approach: | They propose a framework that leverages the dual learning of translation tasks to provide effective feedback, thereby enhancing the models’ self-reflective abilities and improving translation performance. |
| Outcome: | The proposed framework improves the models’ self-reflective abilities and improves translation accuracy and eliminating ambiguities across translation tasks. |