End-to-End Learning of Task-Oriented Dialogs (N18-4)

Copied to clipboard

Challenge: Dissertation addresses the limitations of conventional task-oriented dialog systems . conventions of such systems include a complex pipeline and dialog state tracking .
Approach: They propose a neural network based dialog system that can robustly track dialog state . they propose offline training and online interactive learning methods to improve efficiency .
Outcome: The proposed system can track dialog state, interface with knowledge bases, and integrate structured query results into system responses to successfully complete task-oriented dialog.

Similar Papers

Dialogue Learning with Human Teaching and Feedback in End-to-End Trainable Task-Oriented Dialogue Systems (N18-1)

Copied to clipboard

Challenge: Existing methods for learning task-oriented dialogues include applying reinforcement learning with user feedback on supervised pre-training models.
Approach: They propose a hybrid imitation and reinforcement learning method that integrates user feedback and reinforcement training to improve the agent's performance.
Outcome: The proposed method can learn from the mistake it makes via imitation learning from user teaching and feedback.
End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions (2023.emnlp-main)

Copied to clipboard

Challenge: End-to-end task-oriented dialogue (EToD) can generate responses in an end-to end fashion without modular training, which attracts escalating popularity.
Approach: They present a systematic review of EToD and propose a unified perspective to summarize existing approaches and recent trends.
Outcome: The proposed approaches can generate responses in an end-to-end fashion without modular training, which attracts escalating popularity.
Learning End-to-End Goal-Oriented Dialog with Multiple Answers (D18-1)

Copied to clipboard

Challenge: Existing methods for dialog learning assume there is only one correct next utterance . a significant drop in performance is seen in existing methods for evaluating dialog systems .
Approach: They propose a method that assumes there is only one correct next utterance in a dialog . they propose bAbI dialog tasks that introduce valid next .
Outcome: The proposed method improves performance and achieves 47.3% accuracy on permuted-bAbI dialog tasks.
Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialog (2020.acl-main)

Copied to clipboard

Challenge: Recent studies show remarkable success in end-to-end task-oriented dialog systems . however, most models rely on large training data, which is difficult to scalable for new domains with limited labeled data.
Approach: They propose a shared-private network which exploits the relevance between the target domain and each domain.
Outcome: The proposed model outperforms existing methods on multi-domain dialogue by 13.9% on average.
Mars: Modeling Context & State Representations with Contrastive Learning for End-to-End Task-Oriented Dialog (2023.findings-acl)

Copied to clipboard

Challenge: Empirical results show dialog context representations are more conducive to multi-turn task-oriented dialog.
Approach: They propose an end-to-end task-oriented dialog system with two contrastive learning strategies to model relationship between dialog context and belief/action state representations.
Outcome: Empirical results show that dialog context representations are more conducive to multi-turn task-oriented dialog.
Improving End-to-End Task-Oriented Dialog System with A Simple Auxiliary Task (2021.findings-emnlp)

Copied to clipboard

Challenge: Using large pre-trained language models for end-to-end TOD modeling has made significant progress on benchmarks . a paradigm of leveraging large pretrained models has shown promising results .
Approach: They combine paradigm of leveraging large pre-trained language models with multi-task learning framework . their model achieves new state-of-the-art results with combined scores of 108.3 and 107.5 .
Outcome: The proposed model achieves state-of-the-art results on multiWOZ 2.0 and MultiWOZ 2.1 . it also improves generalization capability through domain adaptation experiments in the few-shot setting.
Learning Low-Resource End-To-End Goal-Oriented Dialog for Fast and Reliable System Deployment (2020.acl-main)

Copied to clipboard

Challenge: Existing end-to-end dialog systems perform less effectively when data is scarce.
Approach: They propose a Meta-Dialog System which combines meta-learning and human-machine collaboration to improve dialog learning by a new extended-bAbI dataset and a transformed MultiWOZ dataset.
Outcome: The proposed system outperforms non-meta-learning baselines on a new extended-bAbI dataset and a transformed MultiWOZ dataset for low-resource goal-oriented dialog learning.
Comet: Dialog Context Fusion Mechanism for End-to-End Task-Oriented Dialog with Multi-task Learning (2025.coling-main)

Copied to clipboard

Challenge: Existing end-to-end task-oriented dialog systems often encounter challenges arising from implicit information, coreference, and the presence of noisy and irrelevant data within the dialog context.
Approach: They propose a dialog context fusion mechanism for end-to-end task-oriented dialog augmented with three additional tasks: dialog summarization, domain prediction, and slot detection.
Outcome: The proposed method achieves state-of-the-art on the MultiWOZ and CrossWOZ datasets.
End-to-End Task-Oriented Dialogue Systems Based on Schema (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches for task-oriented dialogue systems rely on a unified schema across domains, but we propose a schema-aware model for task oriented dialogues based on 'slots'
Approach: They propose a schema-aware end-to-end neural network model for handling task-oriented dialogues based on a dynamic set of slots within a unified schema.
Outcome: The proposed model performs better on a well-known dataset than baselines on 'schema-guided dialogue' systems.
Task-Optimized Adapters for an End-to-End Task-Oriented Dialogue System (2023.findings-acl)

Copied to clipboard

Challenge: Recent work on end-to-end dialogue models with pre-trained dialogue corpora shows promising performance in the conversational system.
Approach: They propose an end-to-end TOD system with task-optimized adapters which learn independently per task adding only small number of parameters after fixed layers of pre-trained network.
Outcome: The proposed system achieves state-of-the-art performance on the MultiWOZ benchmark compared to existing models.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations