Learning from Relevant Subgoals in Successful Dialogs using Iterative Training for Task-oriented Dialog Systems (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Task-oriented Dialog (ToD) systems have to solve multiple subgoals to accomplish user goals, whereas feedback is often obtained only at the end of the dialog. |
| Approach: | They propose an iterative training approach that uses subgoals to improve task-oriented dialog systems. |
| Outcome: | The proposed approach improves on a popular ToD benchmark by combining fine-tuning and preference learning steps. |
Similar Papers
End-to-End Learning of Task-Oriented Dialogs (N18-4)
Copied to clipboard
| Challenge: | Dissertation addresses the limitations of conventional task-oriented dialog systems . conventions of such systems include a complex pipeline and dialog state tracking . |
| Approach: | They propose a neural network based dialog system that can robustly track dialog state . they propose offline training and online interactive learning methods to improve efficiency . |
| Outcome: | The proposed system can track dialog state, interface with knowledge bases, and integrate structured query results into system responses to successfully complete task-oriented dialog. |
Synergizing In-context Learning with Hints for End-to-end Task-oriented Dialog Systems (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing end-to-end task-oriented dialogue systems require extensive training datasets to perform well. |
| Approach: | They propose a system that synergizes LLMs with task-specific hints to improve alignment in low-data settings. |
| Outcome: | The proposed model improves alignment in low-data settings while retaining competitive performance in full-data environments. |
End-to-End Learning of Flowchart Grounded Task-Oriented Dialogs (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems that use human-to-human dialogs to help users with specific tasks are still unexplored. |
| Approach: | They propose a problem in which a dialog system mimics a troubleshooting agent . they use a dataset grounded on 12 different troubleshooking flowcharts to train the agent a neural model . |
| Outcome: | The proposed model can do zero-shot transfer to unseen flowcharts and sets a strong baseline for future research. |
Improving End-to-End Task-Oriented Dialog System with A Simple Auxiliary Task (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Using large pre-trained language models for end-to-end TOD modeling has made significant progress on benchmarks . a paradigm of leveraging large pretrained models has shown promising results . |
| Approach: | They combine paradigm of leveraging large pre-trained language models with multi-task learning framework . their model achieves new state-of-the-art results with combined scores of 108.3 and 107.5 . |
| Outcome: | The proposed model achieves state-of-the-art results on multiWOZ 2.0 and MultiWOZ 2.1 . it also improves generalization capability through domain adaptation experiments in the few-shot setting. |
DKAF: KB Arbitration for Learning Task-Oriented Dialog Systems with Dialog-KB Inconsistencies (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches for learning task-oriented dialog agents assume the KB snapshot is current during training. |
| Approach: | They propose a dialog-KB arbitration framework which predicts the contemporary KB snapshot for each train dialog. |
| Outcome: | The proposed model performs better on two publicly available dialog datasets than baselines on both datasets. |
TOD-Flow: Modeling the Structure of Task-Oriented Dialogues (2023.emnlp-main)
Copied to clipboard
Sungryull Sohn, Yiwei Lyu, Anthony Liu, Lajanugen Logeswaran, Dong-Ki Kim, Dongsub Shim, Honglak Lee
| Challenge: | Recent advances in task-oriented dialogue systems have limitations regarding transparency and controllability. |
| Approach: | They propose to infer the TOD-flow graph from dialog data annotated with dialog acts and integrate it with any dialogue model to improve its prediction performance, transparency, and controllability. |
| Outcome: | The proposed approach improves dialog act classification and response generation performance in the MultiWOZ and SGD benchmarks. |
Comparing Data Augmentation Methods for End-to-End Task-Oriented Dialog Systems (2024.findings-acl)
Copied to clipboard
| Challenge: | Creating effective task-oriented dialog systems is challenging due to the scarcity of training data. |
| Approach: | They empirically evaluate eight DA methods that have shown promising results in task-oriented dialog systems and other NLP systems. |
| Outcome: | The proposed methods have been successful in other NLP systems but not in the ToDSs. |
SynTOD: Augmented Response Synthesis for Robust End-to-End Task-Oriented Dialogue System (2024.lrec-main)
Copied to clipboard
| Challenge: | Task-oriented dialogue systems focus on training multiple tasks such as language understanding, tracking states, and generating appropriate responses to help users achieve their specific goals. |
| Approach: | They exploit the ability of pre-trained models to provide synthesis responses for fine-tuning end-to-end TOD systems. |
| Outcome: | The proposed model outperforms baseline models on multiwoz datasets and is available for further exploitation. |
Learning Dialog Policies from Weak Demonstrations (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to train dialog managers struggle with large state spaces and sparse rewards. |
| Approach: | They propose a deep reinforcement learning algorithm that uses dialog data to guide the agent to successfully respond to a user's requests. |
| Outcome: | Experiments in a multi-domain dialog system framework validate our methods and get high success rates even when trained on out-of-domain data. |
Learning Low-Resource End-To-End Goal-Oriented Dialog for Fast and Reliable System Deployment (2020.acl-main)
Copied to clipboard
| Challenge: | Existing end-to-end dialog systems perform less effectively when data is scarce. |
| Approach: | They propose a Meta-Dialog System which combines meta-learning and human-machine collaboration to improve dialog learning by a new extended-bAbI dataset and a transformed MultiWOZ dataset. |
| Outcome: | The proposed system outperforms non-meta-learning baselines on a new extended-bAbI dataset and a transformed MultiWOZ dataset for low-resource goal-oriented dialog learning. |