Contextualize Knowledge Bases with Transformer for End-to-end Task-Oriented Dialogue Systems (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to integrate knowledge bases into end-to-end task-oriented dialogue systems are limited in their ability to properly represent the entity of KB. |
| Approach: | They propose a framework that dynamically perceives all relevant entities and dialogue history . it uses a Memory Mask to enforce the entity to focus on its relevant entities . |
| Outcome: | The proposed framework can achieve superior performance over the state of the arts. |
Similar Papers
Space Efficient Context Encoding for Non-Task-Oriented Dialogue Generation with Graph Attention Transformer (2021.acl-long)
Copied to clipboard
| Challenge: | Recent Transformer-based models aim to integrate fixed background context into non-task-oriented dialogue systems, but the context length is fixed in these architectures, which restricts how much background or dialogue context can be kept. |
| Approach: | They propose a more concise encoding for background context structured in the form of knowledge graphs by expressing the graph connections through restrictions on the attention weights. |
| Outcome: | The proposed architecture reduces space requirements without negative effects on the precision of reproduction of knowledge and perceived consistency. |
Entity-Consistent End-to-end Task-Oriented Dialogue System with KB Retriever (D19-1)
Copied to clipboard
| Challenge: | Existing work on sequence-to-sequence dialogues treats the KB query as an attention over the entire KB without the guarantee that the generated entities are consistent with each other. |
| Approach: | They propose a framework which queries the knowledge base in two steps to improve consistency . they first return the most relevant KB row given a dialogue history . |
| Outcome: | The proposed framework outperforms baseline models and produces entity-consistent responses. |
GraphDialog: Integrating Graph Knowledge into End-to-End Task-Oriented Dialogue Systems (2020.emnlp-main)
Copied to clipboard
| Challenge: | End-to-end task-oriented dialogue systems aim to generate system responses directly from plain text inputs. |
| Approach: | They propose a recurrent cell architecture which exploits the structural information in dialogue history . they propose recursive cell architecture to allow representation learning on graphs . |
| Outcome: | The proposed model improves on two different datasets on task-oriented dialogues. |
Comet: Dialog Context Fusion Mechanism for End-to-End Task-Oriented Dialog with Multi-task Learning (2025.coling-main)
Copied to clipboard
| Challenge: | Existing end-to-end task-oriented dialog systems often encounter challenges arising from implicit information, coreference, and the presence of noisy and irrelevant data within the dialog context. |
| Approach: | They propose a dialog context fusion mechanism for end-to-end task-oriented dialog augmented with three additional tasks: dialog summarization, domain prediction, and slot detection. |
| Outcome: | The proposed method achieves state-of-the-art on the MultiWOZ and CrossWOZ datasets. |
DIALKI: Knowledge Identification in Conversational Systems through Dialogue-Document Contextualization (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge grounding models focus on locating knowledge in document contexts that are relevant to the conversation. |
| Approach: | They propose a knowledge identification model that leverages document structure to provide dialogue-contextualized passage encodings and better locate knowledge relevant to the conversation. |
| Outcome: | The proposed model can be applied to document-grounded conversational datasets and shows generalization to unseen documents and long dialogue contexts. |
Sequence-to-Sequence Learning for Task-oriented Dialogue with Dialogue State Representation (C18-1)
Copied to clipboard
| Challenge: | Existing pipeline models for task-oriented dialogue system require explicit modeling of dialogue states and hand-crafted action spaces to query domain-specific knowledge base. |
| Approach: | They propose a framework that leverages the advantages of classic pipeline and sequence-to-sequence models. |
| Outcome: | The proposed framework outperforms baseline models on automatic and human evaluation on a Stanford Multi-turn Multi-domain task-oriented dialogue dataset. |
Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systems (2020.findings-emnlp)
Copied to clipboard
Andrea Madotto, Samuel Cahyawijaya, Genta Indra Winata, Yan Xu, Zihan Liu, Zhaojiang Lin, Pascale Fung
| Challenge: | End-to-end systems rely on dialogue state tracking and annotations to fulfill user requests . modularized systems require multiple steps, including a direct interaction with the KB . |
| Approach: | They propose a method to embed the KB directly into the model parameters . they evaluate five task-oriented dialogue datasets with small, medium, and large KBs . |
| Outcome: | The proposed model can embed the KB directly into the model parameters without any DST or template responses, nor the kb as input. |
Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systems (P18-1)
Copied to clipboard
| Challenge: | End-to-end task-oriented dialog systems often suffer from the challenge of incorporating knowledge bases. |
| Approach: | They propose a novel yet simple end-to-end differentiable model called memory-tosequence to address this issue. |
| Outcome: | The proposed model can be trained faster and achieve state-of-the-art performance on three different task-oriented dialog datasets. |
Stateful Memory-Augmented Transformers for Efficient Dialogue Modeling (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing Transformers models are computationally expensive for long context inputs. |
| Approach: | They propose a transformer that can interchange information between memory states and context . they evaluate the efficiency of their model on three dialogue datasets and two language datasets . |
| Outcome: | The proposed model is compatible with existing transformer models and can preserve dialogue history information. |
Infusing Context and Knowledge Awareness in Multi-turn Dialog Understanding (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing work on multi-turn dialog understanding does not model multi-turned dynamics, instead leaving them for updating dialog states only. |
| Approach: | They propose to equip a BERT-based framework with knowledge and context awareness to model multi-turn dialog dynamics by detecting intents and slots within each user utterance. |
| Outcome: | The proposed framework can detect intents and slots within a dialog and extract key slot information as 'semantic frames' however, humans usually associate relevant background knowledge with the current dialog contexts to better illustrate slot semantics revealed from word connotations . |