A Semi-Supervised Stable Variational Network for Promoting Replier-Consistency in Dialogue Generation (D19-1)
Copied to clipboard
| Challenge: | Existing methods favor uninformative and non replier-specific responses due to lack of relevant information guidance. |
| Approach: | They propose to use a semi-supervised variable network to generate replier-specific responses . they use vMF as latent space to obtain stable KL performance . |
| Outcome: | The proposed model outperforms baseline models on two large conversation datasets and generates diverse and replier-specific responses. |
Similar Papers
PVGRU: Generating Diverse and Relevant Dialogue Responses via Pseudo-Variational Mechanism (2023.acl-long)
Copied to clipboard
| Challenge: | Existing generative models for dialogue use the last hidden state to summarize the history of the dialogue. |
| Approach: | They propose a Pseudo-Variational Gated Recurrent Unit (PVGRU) that summarises the accumulated distribution variations of subsequences and builds a model based on it. |
| Outcome: | The proposed model can improve diversity and relevance of responses on two benchmark datasets. |
Towards Low-Resource Semi-Supervised Dialogue Generation with Meta-Learning (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing systems that use labelled data to generate dialogues are lacking in high accuracy. |
| Approach: | They propose a meta-learning based semi-supervised explicit dialogue state tracker for neural dialogue generation, denoted as MEDST. |
| Outcome: | The proposed system outperforms existing systems by 18.7% goal accuracy and 14.3% entity match rate on the KVRET corpus with 2% labelled data in semi-supervision. |
Variational Autoregressive Decoder for Neural Response Generation (D18-1)
Copied to clipboard
| Challenge: | Existing variational Bayesian models generate responses from a single latent variable, which is not sufficient to model high variability in responses. |
| Approach: | They propose a conditional variable auto-encoder that sequentially introduces latent variables to condition the generation of each word in the response sequence. |
| Outcome: | Empirical results show that the proposed model improves on state-of-the-art models on Opensubtitle and Reddit datasets. |
Diversifying Dialogue Generation with Non-Conversational Text (2020.acl-main)
Copied to clipboard
| Challenge: | Neural network-based sequence-to-sequence models suffer from low diversity in open-domain dialogue generation. |
| Approach: | They propose a way to diversify dialogue generation by leveraging non-conversational text . they collect large-scale corpus from forum comments, idioms and book snippets . |
| Outcome: | The proposed model produces significantly more diverse responses without sacrificing relevance with context. |
Adversarial Domain Adaptation for Variational Neural Language Generation in Dialogue Systems (C18-1)
Copied to clipboard
| Challenge: | Existing methods to adapt to domains have shown promising results in how to reuse data in a domain-scalable framework efficiently. |
| Approach: | They propose an adversarial training procedure to train a Variational encoder-decoder based language generator via multiple adaptation steps. |
| Outcome: | The proposed method can adapt to a related domain using only a small amount of in-domain data. |
Speculative Sampling in Variational Autoencoders for Dialogue Response Generation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have tried to improve variational models but they fail to learn proper mappings. |
| Approach: | They propose to use a variable-based sampling technique to find the most probable one from redundantly sampled latent variables to tie up the variable with a given response. |
| Outcome: | The proposed method is effective in response generation with massive dialogue data constructed from Twitter posts. |
A Hierarchical Latent Structure for Variational Conversation Modeling (N18-1)
Copied to clipboard
| Challenge: | Variational autoencoders suffer from the notorious degeneration problem, according to a new study . utterance drop regularization is an important feature of the hierarchical RNNs . |
| Approach: | They propose a variational hierarchical conversation RNN framework that exploits latent variables and an utterance drop regularization to exploit latent variable. |
| Outcome: | The proposed model outperforms state-of-the-art models on Cornell Movie Dialog and Ubuntu Dialog Corpus. |
DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation (2020.acl-demos)
Copied to clipboard
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, Bill Dolan
| Challenge: | DIALOGPT is a large, tunable neural conversational response generation model . trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Approach: | They present a large, tunable neural conversational response generation model, DIALOGPT . the model is trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Outcome: | The proposed model can generate more relevant, contentful and context-consistent responses than baseline systems. |
Syntactically Diverse Adversarial Network for Knowledge-Grounded Conversation Generation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing conversation models produce meaningless and generic responses, which significantly reduce the user experience. |
| Approach: | They propose to fuse knowledge to improve informativeness and adopt latent variables to enhance the diversity of responses. |
| Outcome: | The proposed model can generate syntactically diverse and knowledge-accurate responses while maintaining the knowledge accuracy. |
DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have tried to introduce discrete or Gaussian-based latent variables to address the one-to-many problem, but the diversity is limited. |
| Approach: | They propose a diffusion model to enhance the diversity of dialogue generation by using continuous latent variables instead of discrete ones. |
| Outcome: | The proposed model greatly enhances diversity of dialog response while keeping the coherence. |