Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading (P19-1)
Copied to clipboard
Lianhui Qin, Michel Galley, Chris Brockett, Xiaodong Liu, Xiang Gao, Bill Dolan, Yejin Choi, Jianfeng Gao
| Challenge: | a new approach to contentful neural conversation is proposed . end-to-end models are effective in learning fluent responses, but their responses are often vacuous and uninformative. |
| Approach: | They propose a model that provides the conversation model with relevant text on the fly as a source of external knowledge. |
| Outcome: | The proposed model improves the informativeness and diversity of generated output compared to previous methods. |
Similar Papers
Response-Anticipated Memory for On-Demand Knowledge Integration in Response Generation (2020.acl-main)
Copied to clipboard
| Challenge: | Neural conversation models generate appropriate but non-informative responses in general. |
| Approach: | They propose to construct a document memory with anticipated responses in mind using a teacher-student framework and a student's input. |
| Outcome: | The proposed model outperforms the state-of-the-art for the Conversing by Reading task. |
External Knowledge Acquisition for End-to-End Document-Oriented Dialog Systems (2023.eacl-main)
Copied to clipboard
| Challenge: | End-to-end neural models for conversational AI often assume that a response can be generated by considering only the knowledge acquired during training. |
| Approach: | They propose an architecture for document-oriented conversations with access to external knowledge sources. |
| Outcome: | The proposed architecture outperforms baseline models on the Wizard of Wikipedia dataset by 10.3% and 7.4%. |
Towards Content Transfer through Grounded Text Generation (N19-1)
Copied to clipboard
| Challenge: | Recent work in neural natural language generation has attracted significant interest in controlling the form of text, such as style, persona, and wordiness. |
| Approach: | They propose a task where the task is to generate a next sentence in a document that fits its context and is grounded in . external textual source such as a news story. |
| Outcome: | The proposed task is based on 640k Wikipedia referenced sentences paired with the source articles to show significant improvements against baselines. |
Extending Neural Generative Conversational Model using External Knowledge Sources (D18-1)
Copied to clipboard
| Challenge: | Existing generative dialogue models lack coherence and are content poor . however, current models lack the capacity to handle large unstructured knowledge sources. |
| Approach: | They propose an architecture to incorporate unstructured knowledge sources to enhance the next utterance prediction in chit-chat type of generative dialogue models. |
| Outcome: | The proposed architecture improves the next utterance prediction in chit-chat type of generative dialogue models by incorporating external knowledge from Wikipedia summaries and the NELL knowledge base. |
Towards End-to-End Open Conversational Machine Reading (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing approaches to the problem of open-retrieval conversational machine reading (OR-CMR) use two separate modules to approach the problem's two successive sub-tasks. |
| Approach: | They propose to model OR-CMR as a unified text-to-text task in a fully end-to end style and propose to use a text-based approach to solve the problem. |
| Outcome: | Experiments on the ShARC and OR-ShARC dataset show that the proposed framework can generalize to different backbone models. |
Summary Grounded Conversation Generation (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets for conversation summarization are small due to the lack of large-scale datasets. |
| Approach: | They propose three approaches to generate summary grounded conversations, and evaluate the generated conversations using automatic measures and human judgements. |
| Outcome: | The proposed models can generate entire conversations with only a summary of a conversation as the input. |
DIRECT: Direct and Indirect Responses in Conversational Text Corpus (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Neural conversation models have been able to generate fluent responses through training on a dialogue corpus, but they lack the ability to reveal the implied intentions of users. |
| Approach: | They propose to train neural conversation models on a dialogue corpus that provides pragmatic paraphrases to advance techniques for natural language understanding in dialogue systems. |
| Outcome: | The proposed corpus provides 71,498 pairs of indirect–direct utterance pairs accompanied by a multi-turn dialogue history extracted from the MultiWoZ dataset. |
DIALOGPT : Large-Scale Generative Pre-training for Conversational Response Generation (2020.acl-demos)
Copied to clipboard
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, Bill Dolan
| Challenge: | DIALOGPT is a large, tunable neural conversational response generation model . trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Approach: | They present a large, tunable neural conversational response generation model, DIALOGPT . the model is trained on 147M conversation-like exchanges extracted from Reddit comment chains . |
| Outcome: | The proposed model can generate more relevant, contentful and context-consistent responses than baseline systems. |
Improving Neural Conversational Models with Entropy-Based Data Filtering (P19-1)
Copied to clipboard
| Challenge: | Current neural network-based conversational models lack diversity and generate boring responses to open-ended utterances. |
| Approach: | They propose an unsupervised method of filtering dialog datasets by removing generic utterances from training data using an entropy-based approach that does not require human supervision. |
| Outcome: | The proposed method improves dialog quality as chatbots learn to output more diverse responses to open-ended utterances. |
Bootstrapping a Neural Conversational Agent with Dialogue Self-Play, Crowdsourcing and On-Line Reinforcement Learning (N18-3)
Copied to clipboard
| Challenge: | End-to-end neural models for conversational agents require large corpus of dialogues to learn effectively. |
| Approach: | They propose a method for building an agent for arbitrary tasks by combining dialogue self-play and crowd-sourcing. |
| Outcome: | The proposed approach can be quickly bootstrapped to deploy in front of users and further optimized via interactive learning from actual users. |