Learning to Abstract for Memory-augmented Conversational Response Generation (P19-1)
Copied to clipboard
| Challenge: | Existing generative models for open-domain chit-chat conversations lack informativeness and diversity. |
| Approach: | They propose a retrieval-augmented generative model that learns to abstract from the training corpus and saves useful information to the memory to assist the response generation. |
| Outcome: | The proposed model outperforms other baselines in query-response clustering and learning to utilize these characteristics for response generation. |
Similar Papers
Grounding in social media: An approach to building a chit-chat dialogue model (2022.naacl-srw)
Copied to clipboard
| Challenge: | Existing open-domain dialogue models fail to capture and utilize external knowledge, leading to repetitive or generic responses to unseen utterances. |
| Approach: | They propose to use social media comments to improve the raw conversation ability of open-domain dialogue systems. |
| Outcome: | The proposed model improves the raw conversation ability of open-domain dialogue systems by mimicking human responses through casual interactions found on social media. |
Internet-Augmented Dialogue Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Large language models are known to hallucinate facts when generating dialogue, and are unable to encode the knowledge in the model at the point of training. |
| Approach: | They propose an approach that generates an internet search query based on the context and conditions on the results to generate a response. |
| Outcome: | The proposed model generates an internet search query and then conditions on the results to generate a response. |
RAC: Retrieval-augmented Conversation Dataset for Open-domain Question Answering in Conversational Settings (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing studies constrain questions and answers within predefined contexts, excluding the retrieval process. |
| Approach: | They present a retrieval-augmented conversation dataset that addresses key challenges . they propose a system that combines query rewriting and retrieval with reranking . |
| Outcome: | The proposed system improves query rewriting, retrieval, reranking, and response generation performance. |
Adaptive Retrieval-Augmented Generation for Conversational Systems (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies have shown the effectiveness of retrieving and augmenting external knowledge for informative responses. |
| Approach: | They propose to use a gating model to predict if a conversational system requires retrieval-augmented generation to generate high-quality responses with high confidence. |
| Outcome: | The proposed model can predict if a conversational system requires RAG to generate high-quality responses with high confidence. |
Personalized Response Generation via Generative Split Memory Network (2021.naacl-main)
Copied to clipboard
| Challenge: | Despite the success of text generation and dialogue systems, how to endow a text generation system with personality traits remains under-investigated. |
| Approach: | They propose a model to generate personalized responses on reddit using user profiles and posting histories. |
| Outcome: | The proposed model improves over the state-of-the-art response generation models. |
Learning Retrieval Augmentation for Personalized Dialogue Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Personalized dialogue generation is a popular approach for conversational AI applications . however, persona profiles may not provide comprehensive descriptions of the persona . |
| Approach: | They propose a method that leverages persona profiles and dialogue context to generate personalized dialogues by leveraging personas and persona profile. |
| Outcome: | The proposed method outperforms baselines on the CONVAI2 dataset . it is expected to generate personalized dialogues based on persona profiles and dialogue context . |
Augmenting Transformers with KNN-Based Composite Memory for Dialog (2021.tacl-1)
Copied to clipboard
| Challenge: | Recent work has focused on learning architectures with large memories capable of storing external knowledge. |
| Approach: | They propose a method to augment generative Transformer neural networks with information fetching modules. |
| Outcome: | The proposed approach improves performance in generative dialog modeling . external knowledge is retrieved from Wikipedia, images, and human-written dialog utterances . |
Skeleton-to-Response: Dialogue Generation Guided by Retrieval Memory (N19-1)
Copied to clipboard
| Challenge: | Existing generative dialogue models generate responses from input queries . however, the results are limited and the models are unsatisfactory . |
| Approach: | They propose a framework which exploits retrieval results via a skeleton-to-response paradigm . they extract a query skelet and use it to generate a new skele and response . |
| Outcome: | The proposed approach significantly improves the informativeness of the generated responses. |
Extending Neural Generative Conversational Model using External Knowledge Sources (D18-1)
Copied to clipboard
| Challenge: | Existing generative dialogue models lack coherence and are content poor . however, current models lack the capacity to handle large unstructured knowledge sources. |
| Approach: | They propose an architecture to incorporate unstructured knowledge sources to enhance the next utterance prediction in chit-chat type of generative dialogue models. |
| Outcome: | The proposed architecture improves the next utterance prediction in chit-chat type of generative dialogue models by incorporating external knowledge from Wikipedia summaries and the NELL knowledge base. |
DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation (2020.acl-demos)
Copied to clipboard
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, Bill Dolan
| Challenge: | DIALOGPT is a large, tunable neural conversational response generation model . trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Approach: | They present a large, tunable neural conversational response generation model, DIALOGPT . the model is trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Outcome: | The proposed model can generate more relevant, contentful and context-consistent responses than baseline systems. |