Data Manipulation: Towards Effective Instance Learning for Neural Dialogue Generation via Learning to Augment and Reweight (2020.acl-main)
Copied to clipboard
| Challenge: | Current state-of-the-art neural dialogue models learn from human conversations . however, due to the open-ended nature of human conversations, the quality of training data varies . |
| Approach: | They propose a data manipulation framework to augment and highlight effective training samples . they also propose to increase its manipulation skills through gradient descent with validation samples a reshaping framework to proactively restructure the data distribution towards reliable samples is also proposed . |
| Outcome: | The proposed framework improves the performance of open-domain neural dialogue models with respect to evaluation metrics and human judgments. |
Similar Papers
A Model-agnostic Data Manipulation Method for Persona-based Dialogue Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models for introducing explicit personas are expensive due to their expensive collection costs. |
| Approach: | They propose a data manipulation method which is model-agnostic to be packed with any persona-based dialogue generation model to improve their performance. |
| Outcome: | The proposed method is model-agnostic to be packed with any persona-based dialogue generation model to improve their performance. |
Data Augmentation for Multiclass Utterance Classification – A Systematic Study (2020.coling-main)
Copied to clipboard
| Challenge: | a lack of sufficient training data for some categories can cause imbalanced data distributions . a weak classifier may miscategorize a request, resulting in customer dissatisfaction . |
| Approach: | They propose to use random resampling, word-level transformations and neural text generation to augment existing data to cope with imbalanced data. |
| Outcome: | The proposed methods improve utterance classification results by drawing on utterant variation. |
End-to-end Adversarial Sample Generation for Data Augmentation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for generating adversarial samples have deceived many neural inference models, such as text classification and machine translation. |
| Approach: | They propose an adversarial sample generator that consists of a conditioned paraphrasing model and a condition generator and introduce a pretrained discriminator to help the adversarial sample generator adapt to the data characteristics. |
| Outcome: | The proposed approach improves the performance of the trained model on several tasks and is robust for various attacking techniques. |
A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing studies have focused on conditioned dialogue generation, but there is a scarcity of labeled responses. |
| Approach: | They propose a multi-task learning approach to leverage labeled dialogue and text data to generate conditioned dialogues. |
| Outcome: | The proposed approach outperforms the state-of-the-art models by leveraging the labeled texts and obtains larger improvement compared to the previous methods to leverage text data. |
Leveraging Implicit Feedback from Deployment Data in Dialogue (2024.eacl-short)
Copied to clipboard
| Challenge: | Xu et al., 2023) and Bai ed., 2019) use crowdworkers to collect signals from natural dialogue episodes. |
| Approach: | They use the publicly released BlenderBot deployment data to extract signals from conversations to implicitly measure the quality of a machine-generated utterance. |
| Outcome: | The proposed model improves over baseline models, but some proxy signals can lead to undesirable generations. |
Dialogue Distillation: Open-Domain Dialogue Augmentation Using Unpaired Data (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing research has focused on training open-domain dialogue models using unpaired data. |
| Approach: | They propose a data-level distillation method for training open-domain dialogue models by utilizing unpaired data. |
| Outcome: | The proposed method produces high-quality dialogue pairs with diverse contents, and can improve competitive baselines. |
Data Collection and End-to-End Learning for Conversational AI (D19-2)
Copied to clipboard
| Challenge: | tutorial aims to familiarise research community with recent advances in statistical dialogue systems . focus of tutorial is on learning end-to-end from data and their relation to more common modular systems. |
| Approach: | This tutorial aims to familiarise the research community with the latest advances in statistical dialogue systems . the focus of the tutorial is on recently introduced end-to-end learning for dialogue systems and their relation to more common modular systems. |
| Outcome: | This tutorial aims to familiarise the research community with the recent advances in statistical dialogue systems for open-domain and task-based dialogue paradigms. |
AUGUST: an Automatic Generation Understudy for Synthesizing Conversational Recommendation Datasets (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work on conversational recommendation systems lacks high-quality data . existing datasets lack large-scale and high-level data based on human annotators . |
| Approach: | They propose an automatic dataset synthesis approach that generates large-scale recommendation dialogues using structured graphs based on user-item information from the real world. |
| Outcome: | The proposed approach can generate large-scale and high-quality recommendation dialogues . it exploits user preferences, knowledge graphs, and conversation ability from existing datasets based on real-world data . |
A Synthetic Data Generation Framework for Grounded Dialogues (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to train grounded dialogues require large amounts of data. |
| Approach: | They propose a synthetic data generation framework for grounded dialogues that takes knowledge data and heuristics to determine a dialogue flow and incrementally turn it into a dialog. |
| Outcome: | The proposed framework significantly boosts model performance in training data and low-resource scenarios. |
Improving Neural Conversational Models with Entropy-Based Data Filtering (P19-1)
Copied to clipboard
| Challenge: | Current neural network-based conversational models lack diversity and generate boring responses to open-ended utterances. |
| Approach: | They propose an unsupervised method of filtering dialog datasets by removing generic utterances from training data using an entropy-based approach that does not require human supervision. |
| Outcome: | The proposed method improves dialog quality as chatbots learn to output more diverse responses to open-ended utterances. |