| Challenge: | Existing approaches to generate conversational systems suffer from lack of diversity in responses and generation of short, repetitive and uninteresting responses. |
| Approach: | They propose a novel conversation model that uses similar examples from training data to generate responses. |
| Outcome: | The proposed model outperforms state-of-the-art sequence to sequence learning on several evaluation metrics on two large data sets. |
Similar Papers
Hierarchy Response Learning for Neural Conversation Generation (D19-1)
Copied to clipboard
| Challenge: | Neural conversation generation models can't perceive and express the intention effectively, causing dull and generic responses. |
| Approach: | They propose a hierarchical response generation model to capture conversation intention . they propose an expression reconstruction model and an expression attention model . |
| Outcome: | The proposed model can generate the responses with more appropriate content and expression. |
Text Generation with Exemplar-based Adaptive Decoding (N19-1)
Copied to clipboard
| Challenge: | Empirical results show that the proposed model achieves strong performance and outperforms comparable baselines. |
| Approach: | They propose a conditioned text generation model that uses a template-based approach to generate content from input text. |
| Outcome: | The proposed model outperforms baselines on abstractive text summarization and data-to-text generation. |
HL-EncDec: A Hybrid-Level Encoder-Decoder for Neural Response Generation (C18-1)
Copied to clipboard
| Challenge: | Existing models for conversation systems operate sentences at word-level . word-based models suffer from Unknown Words Issue and Preference Issue . |
| Approach: | They propose a hybrid-level Encoder-Decoder model which utilizes word-level features and character-level ones. |
| Outcome: | The proposed model outperforms non-word-level models in automatic metrics and human annotations on a Chinese corpus. |
MEMD: A Diversity-Promoting Learning Framework for Short-Text Conversation (C18-1)
Copied to clipboard
| Challenge: | Neural encoder-decoder models tend to generate meaningless and generic responses regardless of what the input text is. |
| Approach: | They propose an easy-to-extend learning framework based on latent vectors to provide training guidance without resorting to extra data or complicating network’s inner structure. |
| Outcome: | The proposed framework improves the quality of generated responses according to automatic metrics and human evaluations, yielding more diverse and smooth replies. |
RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to personalized dialogue generation rely on dialogue data paired with user traits, profiles or persona description sentences. |
| Approach: | They propose a hierarchical transformer retriever trained on dialogue domain data to perform personalized retrieval and a context-aware prefix encoder that fuses the retrieved information to the decoder more effectively. |
| Outcome: | The proposed model generates more fluent and personalized responses under a suite of human and automatic metrics and is superior to state-of-the-art baselines on English Reddit conversations. |
Better Conversations by Modeling, Filtering, and Optimizing for Coherence and Diversity (D18-1)
Copied to clipboard
| Challenge: | Existing encoder-decoder models for open domain dialogue generate generic, uninformative, and non-coherent responses. |
| Approach: | They propose to introduce a measure of coherence as the GloVe embedding similarity between dialogue context and generated response to improve output diversity. |
| Outcome: | The proposed model improves on the OpenSubtitles corpus in terms of BLEU score and diversity metrics. |
Adaptive Parameterization for Neural Dialogue Generation (D19-1)
Copied to clipboard
| Challenge: | Existing models of open-domain dialogue generate responses based on sequence-to-sequence paradigms. |
| Approach: | They propose an Adaptive Neural Dialogue generation model which manages various conversations with conversation-specific parameterization. |
| Outcome: | The proposed model performs better on a large-scale conversational dataset. |
Generating More Interesting Responses in Neural Conversation Models with Distributional Constraints (D18-1)
Copied to clipboard
| Challenge: | Neural conversation models tend to generate safe, generic responses for most inputs . this is due to the limitations of likelihood-based decoding objectives in generation tasks with diverse outputs, such as conversation. |
| Approach: | They propose a distributional constraint approach that incorporates side information into the generated responses. |
| Outcome: | The proposed approach generates responses that are less generic without sacrificing plausibility. |
Modelling Context Emotions using Multi-task Learning for Emotion Controlled Dialog Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent research has tackled this task using neural generative methods by augmenting emotion classes with the input sequences. |
| Approach: | They propose to use a self-attention based encoder and a decoder with dot product attention mechanism to generate a viable response with a specified emotion. |
| Outcome: | The proposed model outperforms baselines on automatic evaluation measures such as F1 and BLEU scores, thus resulting in more fluent and adequate responses. |
Unsupervised Discrete Sentence Representation Learning for Interpretable Neural Dialog Generation (P18-1)
Copied to clipboard
| Challenge: | Existing encoder-decoder dialog models cannot output interpretable actions as in traditional systems. |
| Approach: | They propose an unsupervised discrete sentence representation learning method that integrates with existing encoder-decoder dialog models for interpretable response generation. |
| Outcome: | The proposed model can be integrated with existing encoder-decoder dialog models and discover interpretable semantics via either auto encoding or context predicting. |