| Challenge: | Neural models generate the most common and generic responses all the time . Empirical results show that our method can significantly improve the diversity of responses generated by sequence-to-sequence models. |
| Approach: | They propose an iterative training process and ensemble method based on boosting to improve the diversity of responses generated by neural models. |
| Outcome: | Empirical results show that the proposed method significantly improves diversity and relevance of responses generated by all models. |
Similar Papers
DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation (2020.acl-demos)
Copied to clipboard
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, Bill Dolan
| Challenge: | DIALOGPT is a large, tunable neural conversational response generation model . trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Approach: | They present a large, tunable neural conversational response generation model, DIALOGPT . the model is trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Outcome: | The proposed model can generate more relevant, contentful and context-consistent responses than baseline systems. |
Adversarial Learning on the Latent Space for Diverse Dialog Generation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for dialog generation generate generic utterances, e.g., always generating "I don't know" |
| Approach: | They propose a framework that uses generative adversarial nets to generate conditioned responses in dialogs. |
| Outcome: | The proposed model generates more fluent, relevant, and diverse responses than state-of-the-art methods. |
DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation (2022.acl-long)
Copied to clipboard
Wei Chen, Yeyun Gong, Song Wang, Bolun Yao, Weizhen Qi, Zhongyu Wei, Xiaowu Hu, Bartuer Zhou, Yi Mao, Weizhu Chen, Biao Cheng, Nan Duan
| Challenge: | Existing pre-trained dialog models shed light on various downstream tasks in natural language processing (NLP). |
| Approach: | They propose a dialog pre-training framework that introduces latent variables into the enhanced encoder-decoder pre-train framework to increase relevance and diversity of responses. |
| Outcome: | The proposed model achieves state-of-the-art on personaChat, DailyDialog, and DSTC7-AVSD datasets. |
EM Pre-training for Multi-party Dialogue Response Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to pretrain large language models for dialogue response generation are difficult due to the lack of annotated addressee labels in multi-party dialogue datasets. |
| Approach: | They propose an Expectation-Maximization approach that iteratively performs expectation steps to generate addressee labels and maximize a response generation model. |
| Outcome: | The proposed method is based on two-party dialogues and multi-party dialogs. |
Paraphrase Augmented Task-Oriented Dialog Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Neural generative models can perform dialog generation tasks with a large data set, but lack of high-quality data and expensive data annotation process limit their application in real world settings. |
| Approach: | They propose to combine paraphrase and response generation models to improve dialog generation performance by annotating dialog states and dialog act labels. |
| Outcome: | The proposed framework outperforms existing methods significantly in dialog generation tasks, especially under low resource settings. |
Retrieval-Enhanced Adversarial Training for Neural Response Generation (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to dialogue systems are labor-intensive and difficult to scale up. |
| Approach: | They propose a Retrieval-Enhanced Adversarial Training method for neural response generation that leverages an adversarial training paradigm while taking advantage of N-best response candidates from a retrieval-based system to construct the discriminator. |
| Outcome: | The proposed method outperforms the vanilla Seq2Seq model and conventional adversarial training approach on a large scale dataset. |
Are Training Samples Correlated? Learning to Generate Dialogue Responses with Multiple References (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to open-domain dialogue generation ignore the nature of 1-to-1 mapping that there may exist multiple valid responses corresponding to the same query. |
| Approach: | They propose to model open-domain dialogue generation using 1-to-1 mapping . they first extract common features of different responses and then combine them with distinctive features to generate multiple diverse and appropriate responses. |
| Outcome: | The proposed model outperforms existing models on automatic and human evaluations. |
Learning a Simple and Effective Model for Multi-turn Response Generation with Auxiliary Tasks (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to multi-turn response generation for open-domain dialogues have a complexity problem . auxiliary tasks that relate to context understanding can guide the learning of the generation model . |
| Approach: | They propose a multi-turn response generation model that has a simple structure yet can effectively leverage conversation contexts for response generation. |
| Outcome: | The proposed model outperforms state-of-the-art models in response quality and human judgment . it also enjoys a faster decoding process . |
Language Model as an Annotator: Exploring DialoGPT for Dialogue Summarization (2021.acl-long)
Copied to clipboard
| Challenge: | Existing dialogue summarization systems encode text with a number of general semantic features, but these are often not available in open-domain tools. |
| Approach: | They propose to use DialoGPT to label three types of features on two datasets . they propose to employ pre-trained and non-pre-tried models as dialogue annotators . |
| Outcome: | The proposed method improves on two dialogue summarization datasets and achieves state-of-the-art performance. |
Unsupervised Discrete Sentence Representation Learning for Interpretable Neural Dialog Generation (P18-1)
Copied to clipboard
| Challenge: | Existing encoder-decoder dialog models cannot output interpretable actions as in traditional systems. |
| Approach: | They propose an unsupervised discrete sentence representation learning method that integrates with existing encoder-decoder dialog models for interpretable response generation. |
| Outcome: | The proposed model can be integrated with existing encoder-decoder dialog models and discover interpretable semantics via either auto encoding or context predicting. |