| Challenge: | Existing approaches to handle task-oriented dialogs break when asked to handle such changes. |
| Approach: | They propose an encoder-decoder architecture with a novel Bag-of-Sequences memory which facilitates the disentangled learning of the response’s language model and its knowledge incorporation. |
| Outcome: | The proposed architecture outperforms state-of-the-art models on bAbI OOV test sets and other human-human datasets and shows that it is robust to KB modifications. |
Similar Papers
Contextualize Knowledge Bases with Transformer for End-to-end Task-Oriented Dialogue Systems (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to integrate knowledge bases into end-to-end task-oriented dialogue systems are limited in their ability to properly represent the entity of KB. |
| Approach: | They propose a framework that dynamically perceives all relevant entities and dialogue history . it uses a Memory Mask to enforce the entity to focus on its relevant entities . |
| Outcome: | The proposed framework can achieve superior performance over the state of the arts. |
Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systems (P18-1)
Copied to clipboard
| Challenge: | End-to-end task-oriented dialog systems often suffer from the challenge of incorporating knowledge bases. |
| Approach: | They propose a novel yet simple end-to-end differentiable model called memory-tosequence to address this issue. |
| Outcome: | The proposed model can be trained faster and achieve state-of-the-art performance on three different task-oriented dialog datasets. |
GraphDialog: Integrating Graph Knowledge into End-to-End Task-Oriented Dialogue Systems (2020.emnlp-main)
Copied to clipboard
| Challenge: | End-to-end task-oriented dialogue systems aim to generate system responses directly from plain text inputs. |
| Approach: | They propose a recurrent cell architecture which exploits the structural information in dialogue history . they propose recursive cell architecture to allow representation learning on graphs . |
| Outcome: | The proposed model improves on two different datasets on task-oriented dialogues. |
Unsupervised Discrete Sentence Representation Learning for Interpretable Neural Dialog Generation (P18-1)
Copied to clipboard
| Challenge: | Existing encoder-decoder dialog models cannot output interpretable actions as in traditional systems. |
| Approach: | They propose an unsupervised discrete sentence representation learning method that integrates with existing encoder-decoder dialog models for interpretable response generation. |
| Outcome: | The proposed model can be integrated with existing encoder-decoder dialog models and discover interpretable semantics via either auto encoding or context predicting. |
Joint Reasoning on Hybrid-knowledge sources for Task-Oriented Dialog (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing systems for task oriented dialog use knowledge present only in structured knowledge sources to generate responses. |
| Approach: | They propose a model that assumes that information is always present in a structured knowledge base . they also refine the model to take into account the fact that it can fuse information from structured and unstructured knowledge sources. |
| Outcome: | The proposed model is robust to perturbations to knowledge modality and can fuse information from structured and unstructured knowledge to generate responses. |
DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation (2022.acl-long)
Copied to clipboard
Wei Chen, Yeyun Gong, Song Wang, Bolun Yao, Weizhen Qi, Zhongyu Wei, Xiaowu Hu, Bartuer Zhou, Yi Mao, Weizhu Chen, Biao Cheng, Nan Duan
| Challenge: | Existing pre-trained dialog models shed light on various downstream tasks in natural language processing (NLP). |
| Approach: | They propose a dialog pre-training framework that introduces latent variables into the enhanced encoder-decoder pre-train framework to increase relevance and diversity of responses. |
| Outcome: | The proposed model achieves state-of-the-art on personaChat, DailyDialog, and DSTC7-AVSD datasets. |
A Corpus of Controlled Opinionated and Knowledgeable Movie Discussions for Training Neural Conversation Models (2020.lrec-1)
Copied to clipboard
| Challenge: | Fully data driven Chatbots suffer from inconsistent behaviour across their turns due to a general difficulty in controlling parameters like their assumed background personality and knowledge of facts. |
| Approach: | They propose a model that is based on pre-specified facts and opinions and validates the dialogues for adherence to their given fact and opinion profile. |
| Outcome: | The proposed model is able to generate opinionated responses that are judged to be natural and knowledgeable and show attentiveness. |
DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generation (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent research focused on knowledge distillation methods where the underlying relationship between the facts in a knowledge base is not effectively captured. |
| Approach: | They propose a novel task-oriented dialogue system that effectively incorporates knowledge into a language model by using structural information of a knowledge graph. |
| Outcome: | The proposed system views relational knowledge as a knowledge graph and introduces (1) a structure-aware knowledge embedding technique, and (2) a Knowledge graph-weighted attention masking strategy to facilitate the system selecting relevant information during the dialogue generation. |
Task-Oriented Conversation Generation Using Heterogeneous Memory Networks (D19-1)
Copied to clipboard
| Challenge: | Existing memory networks do not perform well when leveraging heterogeneous information from different sources. |
| Approach: | They propose to use user utterances, dialogue history and background knowledge tuples to integrate external knowledge into a neural dialogue model. |
| Outcome: | The proposed model outperforms the state-of-the-art data-driven task-oriented dialogue models on real-world datasets. |
End-to-End Learning of Task-Oriented Dialogs (N18-4)
Copied to clipboard
| Challenge: | Dissertation addresses the limitations of conventional task-oriented dialog systems . conventions of such systems include a complex pipeline and dialog state tracking . |
| Approach: | They propose a neural network based dialog system that can robustly track dialog state . they propose offline training and online interactive learning methods to improve efficiency . |
| Outcome: | The proposed system can track dialog state, interface with knowledge bases, and integrate structured query results into system responses to successfully complete task-oriented dialog. |