A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing studies have focused on conditioned dialogue generation, but there is a scarcity of labeled responses. |
| Approach: | They propose a multi-task learning approach to leverage labeled dialogue and text data to generate conditioned dialogues. |
| Outcome: | The proposed approach outperforms the state-of-the-art models by leveraging the labeled texts and obtains larger improvement compared to the previous methods to leverage text data. |
Similar Papers
Hello, It’s GPT-2 - How Can I Help You? Towards the Use of Pretrained Language Models for Task-Oriented Dialogue Systems (D19-56)
Copied to clipboard
| Challenge: | Statistical conversational systems are complex, timeintensive, expensive, and not easily transferable due to data scarcity. |
| Approach: | They propose a task-oriented dialogue model that operates on text input . they validate it on multi-domain task-orientated dialogues from a multi-word dataset . |
| Outcome: | The proposed model bypasses explicit policy and language generation modules on multi-domain task-oriented dialogues from the MultiWOZ dataset. |
Multi-Task Learning of Generation and Classification for Emotion-Aware Dialogue Response Generation (2021.naacl-srw)
Copied to clipboard
| Challenge: | Existing models for human-like interaction with humans are not expected to improve the accuracy of emotion recognition, but instead focus on generating emotion-aware responses. |
| Approach: | They propose a neural response generation model with multi-task learning of generation and classification, focusing on emotion. |
| Outcome: | The proposed model makes generated responses more emotionally aware. |
Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue (D19-1)
Copied to clipboard
| Challenge: | Existing methods to generate natural language for task-oriented dialogues lack naturalness and variation in language. |
| Approach: | They propose a multi-task learning framework for natural language generation that explicitly targets for naturalness in generated responses via an unconditioned language model. |
| Outcome: | The proposed framework outperforms existing models across multiple datasets in the study of natural language generation. |
Re-framing Incremental Deep Language Models for Dialogue Processing with Multi-task Learning (2020.coling-main)
Copied to clipboard
| Challenge: | Using a multi-task learning framework, we train a universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging and utterance segmentation in a simple deep recurrent setting. |
| Approach: | They propose a multi-task learning framework to train a universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging and utterance segmentation in a simple deep recurrent setting. |
| Outcome: | The proposed model outperforms individual tasks and delivers competitive performance. |
Pretrained Language Models for Dialogue Generation with Multiple Input Sources (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale pretrained language models have achieved outstanding performance on natural language understanding tasks. |
| Approach: | They propose to fuse attention information from multiple input sources to achieve better relevance with dialogue history than simple fusion baselines. |
| Outcome: | The proposed models deliver higher relevance with dialogue history than baselines. |
Data Manipulation: Towards Effective Instance Learning for Neural Dialogue Generation via Learning to Augment and Reweight (2020.acl-main)
Copied to clipboard
| Challenge: | Current state-of-the-art neural dialogue models learn from human conversations . however, due to the open-ended nature of human conversations, the quality of training data varies . |
| Approach: | They propose a data manipulation framework to augment and highlight effective training samples . they also propose to increase its manipulation skills through gradient descent with validation samples a reshaping framework to proactively restructure the data distribution towards reliable samples is also proposed . |
| Outcome: | The proposed framework improves the performance of open-domain neural dialogue models with respect to evaluation metrics and human judgments. |
Robust Task-Oriented Dialogue Generation with Contrastive Pre-training and Adversarial Filtering (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Task-oriented dialogue models can learn non-transferable generalizations by using shortcuts in the data. |
| Approach: | They propose a contrastive learning framework to encourage models to ignore cues and focus on generalisable patterns. |
| Outcome: | The proposed framework performs exceptionally well on task-oriented dialogue datasets. |
Adaptive Natural Language Generation for Task-oriented Dialogue via Reinforcement Learning (2022.coling-1)
Copied to clipboard
| Challenge: | In task-oriented dialogue systems, the role of the natural language generation component is to convert a system's intentions, called dialogue acts (DAs), into natural language utterances and to convey DAs accurately to users. |
| Approach: | They propose a method for Adaptive Natural language generation for Task-Oriented dialogue via Reinforcement learning that incorporates a natural language understanding module into the objective function of RL. |
| Outcome: | The proposed method generates adaptive utterances against speech recognition errors and the different vocabulary levels of users in a multi-world task-oriented dialogue system. |
EM Pre-training for Multi-party Dialogue Response Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to pretrain large language models for dialogue response generation are difficult due to the lack of annotated addressee labels in multi-party dialogue datasets. |
| Approach: | They propose an Expectation-Maximization approach that iteratively performs expectation steps to generate addressee labels and maximize a response generation model. |
| Outcome: | The proposed method is based on two-party dialogues and multi-party dialogs. |
Learning a Simple and Effective Model for Multi-turn Response Generation with Auxiliary Tasks (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to multi-turn response generation for open-domain dialogues have a complexity problem . auxiliary tasks that relate to context understanding can guide the learning of the generation model . |
| Approach: | They propose a multi-turn response generation model that has a simple structure yet can effectively leverage conversation contexts for response generation. |
| Outcome: | The proposed model outperforms state-of-the-art models in response quality and human judgment . it also enjoys a faster decoding process . |