Task-Optimized Adapters for an End-to-End Task-Oriented Dialogue System (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent work on end-to-end dialogue models with pre-trained dialogue corpora shows promising performance in the conversational system. |
| Approach: | They propose an end-to-end TOD system with task-optimized adapters which learn independently per task adding only small number of parameters after fixed layers of pre-trained network. |
| Outcome: | The proposed system achieves state-of-the-art performance on the MultiWOZ benchmark compared to existing models. |
Similar Papers
SynTOD: Augmented Response Synthesis for Robust End-to-End Task-Oriented Dialogue System (2024.lrec-main)
Copied to clipboard
| Challenge: | Task-oriented dialogue systems focus on training multiple tasks such as language understanding, tracking states, and generating appropriate responses to help users achieve their specific goals. |
| Approach: | They exploit the ability of pre-trained models to provide synthesis responses for fine-tuning end-to-end TOD systems. |
| Outcome: | The proposed model outperforms baseline models on multiwoz datasets and is available for further exploitation. |
Improving End-to-End Task-Oriented Dialog System with A Simple Auxiliary Task (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Using large pre-trained language models for end-to-end TOD modeling has made significant progress on benchmarks . a paradigm of leveraging large pretrained models has shown promising results . |
| Approach: | They combine paradigm of leveraging large pre-trained language models with multi-task learning framework . their model achieves new state-of-the-art results with combined scores of 108.3 and 107.5 . |
| Outcome: | The proposed model achieves state-of-the-art results on multiWOZ 2.0 and MultiWOZ 2.1 . it also improves generalization capability through domain adaptation experiments in the few-shot setting. |
End-to-End Neural Pipeline for Goal-Oriented Dialogue Systems using GPT-2 (2020.acl-main)
Copied to clipboard
| Challenge: | End-to-end dialogue systems with monolithic neural architecture are often trained with input-output utterances without taking into account the entire annotations available in the corpus. |
| Approach: | They propose an end-to-end neural architecture for goal-oriented dialogue systems that addresses both challenges . they propose a modular architecture where modules are optimized individually . |
| Outcome: | The proposed system achieved the top position in the human evaluation task . it is based on a neural architecture that can be integrated with external systems . |
DS-TOD: Efficient Domain Specialization for Task-Oriented Dialog (2022.findings-acl)
Copied to clipboard
| Challenge: | Recent work shows that self-supervised dialog-specific pretraining on large conversational datasets yields substantial gains over traditional language modeling (LM) pretraining. |
| Approach: | They propose a resource-efficient and modular domain specialization by means of domain adapters in which domain knowledge is encoded. |
| Outcome: | The proposed framework extracts domain-specific terms and then uses them to build DomainCC and DomainReddit resources based on masked language modeling and response selection objectives. |
End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions (2023.emnlp-main)
Copied to clipboard
| Challenge: | End-to-end task-oriented dialogue (EToD) can generate responses in an end-to end fashion without modular training, which attracts escalating popularity. |
| Approach: | They present a systematic review of EToD and propose a unified perspective to summarize existing approaches and recent trends. |
| Outcome: | The proposed approaches can generate responses in an end-to-end fashion without modular training, which attracts escalating popularity. |
Synergizing In-context Learning with Hints for End-to-end Task-oriented Dialog Systems (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing end-to-end task-oriented dialogue systems require extensive training datasets to perform well. |
| Approach: | They propose a system that synergizes LLMs with task-specific hints to improve alignment in low-data settings. |
| Outcome: | The proposed model improves alignment in low-data settings while retaining competitive performance in full-data environments. |
TOD-Flow: Modeling the Structure of Task-Oriented Dialogues (2023.emnlp-main)
Copied to clipboard
Sungryull Sohn, Yiwei Lyu, Anthony Liu, Lajanugen Logeswaran, Dong-Ki Kim, Dongsub Shim, Honglak Lee
| Challenge: | Recent advances in task-oriented dialogue systems have limitations regarding transparency and controllability. |
| Approach: | They propose to infer the TOD-flow graph from dialog data annotated with dialog acts and integrate it with any dialogue model to improve its prediction performance, transparency, and controllability. |
| Outcome: | The proposed approach improves dialog act classification and response generation performance in the MultiWOZ and SGD benchmarks. |
Rethinking Task-Oriented Dialogue Systems: From Complex Modularity to Zero-Shot Autonomous Agent (2024.acl-long)
Copied to clipboard
| Challenge: | Task-oriented dialogue systems are designed to be composed of several functional modules, but lacks a general-purpose instruction-following language model. |
| Approach: | They propose a fully zero-shot autonomous TOD agent that leverages a general-purpose instruction-following language model to decide what to do at each dialogue turn. |
| Outcome: | The proposed agent can perform tasks in real-life scenarios with a general-purpose instruction-following language model. |
End-to-End Learning of Task-Oriented Dialogs (N18-4)
Copied to clipboard
| Challenge: | Dissertation addresses the limitations of conventional task-oriented dialog systems . conventions of such systems include a complex pipeline and dialog state tracking . |
| Approach: | They propose a neural network based dialog system that can robustly track dialog state . they propose offline training and online interactive learning methods to improve efficiency . |
| Outcome: | The proposed system can track dialog state, interface with knowledge bases, and integrate structured query results into system responses to successfully complete task-oriented dialog. |
Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systems (2020.findings-emnlp)
Copied to clipboard
Andrea Madotto, Samuel Cahyawijaya, Genta Indra Winata, Yan Xu, Zihan Liu, Zhaojiang Lin, Pascale Fung
| Challenge: | End-to-end systems rely on dialogue state tracking and annotations to fulfill user requests . modularized systems require multiple steps, including a direct interaction with the KB . |
| Approach: | They propose a method to embed the KB directly into the model parameters . they evaluate five task-oriented dialogue datasets with small, medium, and large KBs . |
| Outcome: | The proposed model can embed the KB directly into the model parameters without any DST or template responses, nor the kb as input. |