| Challenge: | Existing models for dialogue generation are unable to integrate information from multiple semantically similar valid responses of a given prompt. |
| Approach: | They propose to learn the pair relationship between the prompts and responses as a regression task instead of the end-to-end classification on vocabulary. |
| Outcome: | The proposed model learns the pair relationship between the prompts and responses on a latent space instead of the end-to-end classification on vocabulary. |
Similar Papers
Adversarial Learning on the Latent Space for Diverse Dialog Generation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for dialog generation generate generic utterances, e.g., always generating "I don't know" |
| Approach: | They propose a framework that uses generative adversarial nets to generate conditioned responses in dialogs. |
| Outcome: | The proposed model generates more fluent, relevant, and diverse responses than state-of-the-art methods. |
Are Training Samples Correlated? Learning to Generate Dialogue Responses with Multiple References (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to open-domain dialogue generation ignore the nature of 1-to-1 mapping that there may exist multiple valid responses corresponding to the same query. |
| Approach: | They propose to model open-domain dialogue generation using 1-to-1 mapping . they first extract common features of different responses and then combine them with distinctive features to generate multiple diverse and appropriate responses. |
| Outcome: | The proposed model outperforms existing models on automatic and human evaluations. |
Retrieval-guided Dialogue Response Generation via a Matching-to-Generation Framework (D19-1)
Copied to clipboard
| Challenge: | generative models for end-to-end sequence generation have been shown promising for this task . however, how to precisely extract a skeleton and how to effectively train a retrieval-guided response generator is still challenging. |
| Approach: | They propose a framework where skeleton extraction is made by an interpretable matching model and a retrieval-guided response generator is followed by a separate generator. |
| Outcome: | The proposed framework outperforms baseline models in a variety of experiments. |
A Generative Model for Joint Natural Language Understanding and Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Natural language understanding (NLU) and natural language generation (NLG) have opposite goals. |
| Approach: | They propose a generative model which couples NLU and NLG through a shared latent variable. |
| Outcome: | The proposed model achieves state-of-the-art performance on two dialogue datasets with flat and tree-structured formal representations. |
PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variable (2020.acl-main)
Copied to clipboard
| Challenge: | Existing pre-training models for dialogue generation have been proven effective for a wide range of tasks. |
| Approach: | They propose a dialogue generation pre-training framework that leverages bi-directional context and uni-directional characteristic of language generation. |
| Outcome: | The proposed framework is superior to existing models on three publicly available datasets. |
DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies have tried to introduce discrete or Gaussian-based latent variables to address the one-to-many problem, but the diversity is limited. |
| Approach: | They propose a diffusion model to enhance the diversity of dialogue generation by using continuous latent variables instead of discrete ones. |
| Outcome: | The proposed model greatly enhances diversity of dialog response while keeping the coherence. |
Efficient Latent Variable Modeling for Knowledge-Grounded Dialogue Generation (2023.findings-emnlp)
Copied to clipboard
Gunsoo Han, Daejin Jo, Daniel Nam, Eunseop Yoon, Taehwan Kwon, Seungeun Rho, Kyoung-Woon On, Chang Yoo, Sungwoong Kim
| Challenge: | Existing knowledge-grounded dialogue generation algorithms require annotated knowledge to generate a response grounded on the retrieved knowledge. |
| Approach: | They propose an efficient algorithm for latent variable modeling that leverages large amount of dialogue data. |
| Outcome: | The proposed algorithm outperforms the supervised learning algorithm on knowledge-grounded dialogue datasets while maintaining efficiency and scalability. |
Generalizable and Explainable Dialogue Generation via Explicit Action Learning (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Conditioned response generation for task-oriented dialogues implicitly optimizes task completion and language quality. |
| Approach: | They propose to learn natural language actions that represent utterances as a span of words. |
| Outcome: | The proposed approach outperforms latent action baselines on a multi-domain dataset. |
Multi-Domain Dialogue Acts and Response Co-Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing pipeline approaches for task-oriented dialogue systems tend to predict multiple dialogue acts first and use them to assist response generation. |
| Approach: | They propose a neural co-generation model that generates dialogue acts and responses concurrently and preserves semantic structures of multi-domain dialogue acts. |
| Outcome: | The proposed model improves over state-of-the-art models in automatic and human evaluations on a large-scale dataset. |
More is Better: Enhancing Open-Domain Dialogue Generation via Multi-Source Heterogeneous Knowledge (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge-enhanced methods use a single-source homogeneous knowledge base with limited knowledge coverage. |
| Approach: | They propose a multi-source heterogeneous knowledge-enhanced dialogue generation model that leverages multiple knowledge sources to improve knowledge coverage. |
| Outcome: | The proposed model outperforms existing knowledge-enhanced models on a Chinese dataset and shows that it can leverage multiple heterogeneous knowledge sources to improve knowledge coverage. |