Jeffrey Zhao, Yuan Cao, Raghav Gupta, Harrison Lee, Abhinav Rastogi, Mingqiu Wang, Hagen Soltau, Izhak Shafran, Yonghui Wu
| Challenge: | a neuro-symbolic approach allows zero-shot adaptation to unseen tasks and domains . a neural LM keeps track of events that occur during a conversation and a symbolic program implements dialog policy is executed to recommend actions. |
| Approach: | They propose an end-to-end, zero-shot task-oriented dialog system . it is designed to adapt to unseen tasks or domains without prior training . |
| Outcome: | The proposed system can be programmed to adapt to unseen tasks without training . it reduces data collection and training requirements for enabling new TOD 1 16189 tasks . |
Similar Papers
Rethinking Task-Oriented Dialogue Systems: From Complex Modularity to Zero-Shot Autonomous Agent (2024.acl-long)
Copied to clipboard
| Challenge: | Task-oriented dialogue systems are designed to be composed of several functional modules, but lacks a general-purpose instruction-following language model. |
| Approach: | They propose a fully zero-shot autonomous TOD agent that leverages a general-purpose instruction-following language model to decide what to do at each dialogue turn. |
| Outcome: | The proposed agent can perform tasks in real-life scenarios with a general-purpose instruction-following language model. |
TransferTOD: A Generalizable Chinese Multi-Domain Task-Oriented Dialogue System with Transfer Capabilities (2024.emnlp-main)
Copied to clipboard
Ming Zhang, Caishuang Huang, Yilong Wu, Shichun Liu, Huiyuan Zheng, Yurui Dong, Yujiong Shen, Shihan Dou, Jun Zhao, Junjie Ye, Qi Zhang, Tao Gui, Xuanjing Huang
| Challenge: | Current datasets cater to user-led systems and are limited to predefined specific scenarios and slots. |
| Approach: | They propose to use a Chinese dialogue dataset to train a model that authentically simulates human-computer dialogues in 30 popular life service scenarios. |
| Outcome: | The proposed model achieves a joint accuracy of 75.09% in out-of-domain evaluations . it also achieves notable abilities in slot filling and questioning . |
SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that SGP-TOD provides state-of-the-art zero-shot performance . prevailing approach for creating task bots is to fine-tune pre-trained language models . |
| Approach: | They propose a Schema-Guided Prompting for building Task-Oriented Dialog systems . they use predefined task schema and dialog policy to instruct fixed LLMs to generate appropriate responses . |
| Outcome: | The proposed system outperforms few-shot approaches on multiwoz, RADDLE, and STAR datasets. |
SynTOD: Augmented Response Synthesis for Robust End-to-End Task-Oriented Dialogue System (2024.lrec-main)
Copied to clipboard
| Challenge: | Task-oriented dialogue systems focus on training multiple tasks such as language understanding, tracking states, and generating appropriate responses to help users achieve their specific goals. |
| Approach: | They exploit the ability of pre-trained models to provide synthesis responses for fine-tuning end-to-end TOD systems. |
| Outcome: | The proposed model outperforms baseline models on multiwoz datasets and is available for further exploitation. |
End-to-End Learning of Flowchart Grounded Task-Oriented Dialogs (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems that use human-to-human dialogs to help users with specific tasks are still unexplored. |
| Approach: | They propose a problem in which a dialog system mimics a troubleshooting agent . they use a dataset grounded on 12 different troubleshooking flowcharts to train the agent a neural model . |
| Outcome: | The proposed model can do zero-shot transfer to unseen flowcharts and sets a strong baseline for future research. |
Few-shot Natural Language Generation for Task-Oriented Dialog (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for NLG depend on heavily annotated data, which is infeasible for new domains. |
| Approach: | They propose a system that converts a dialog act into a response in natural language . they propose 'nuclear language generation' to simulate a few-shot learning setting . |
| Outcome: | The proposed model outperforms existing methods on a large set of annotated datasets. |
Improving End-to-End Task-Oriented Dialog System with A Simple Auxiliary Task (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Using large pre-trained language models for end-to-end TOD modeling has made significant progress on benchmarks . a paradigm of leveraging large pretrained models has shown promising results . |
| Approach: | They combine paradigm of leveraging large pre-trained language models with multi-task learning framework . their model achieves new state-of-the-art results with combined scores of 108.3 and 107.5 . |
| Outcome: | The proposed model achieves state-of-the-art results on multiWOZ 2.0 and MultiWOZ 2.1 . it also improves generalization capability through domain adaptation experiments in the few-shot setting. |
AutoEval-ToD: Automated Evaluation of Task-oriented Dialog Systems (2025.naacl-long)
Copied to clipboard
| Challenge: | Current evaluation methodologies heavily depend on human annotators, which can be inefficient, subjective, and expensive to scale. |
| Approach: | They propose an automated end-to-end evaluation framework that interacts with the ToD system and then assesses its performance across key dimensions. |
| Outcome: | The proposed framework first interacts with the ToD system and assesses its performance across key dimensions by analyzing both its responses and internal states. |
Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System (2022.acl-long)
Copied to clipboard
| Challenge: | Existing pre-trained language models often form a cascaded generation problem . this can lead to error accumulation across different sub-tasks and greater data annotation overhead. |
| Approach: | They propose a plug-and-play model for task-oriented dialogue that learns primary TOD task completion skills from heterogeneous dialog corpora. |
| Outcome: | The proposed model learns primary TOD task completion skills from heterogeneous dialog corpora. |
Multi2WOZ: A Robust Multilingual Dataset and Conversational Pretraining for Task-Oriented Dialog (2022.naacl-main)
Copied to clipboard
| Challenge: | Task-oriented dialog (TOD) is arguably one of the most popular natural language processing (NLP) application areas. |
| Approach: | They propose a multilingual multi-domain TOD dataset that spans four languages . they use a framework for multilingual conversational specialization of pretrained language models . |
| Outcome: | The proposed datasets show that they perform better than existing datasets in English . the proposed framework allows for sample-efficient few-shot transfer for TOD tasks . |