DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generation (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent research focused on knowledge distillation methods where the underlying relationship between the facts in a knowledge base is not effectively captured. |
| Approach: | They propose a novel task-oriented dialogue system that effectively incorporates knowledge into a language model by using structural information of a knowledge graph. |
| Outcome: | The proposed system views relational knowledge as a knowledge graph and introduces (1) a structure-aware knowledge embedding technique, and (2) a Knowledge graph-weighted attention masking strategy to facilitate the system selecting relevant information during the dialogue generation. |
Similar Papers
GraphDialog: Integrating Graph Knowledge into End-to-End Task-Oriented Dialogue Systems (2020.emnlp-main)
Copied to clipboard
| Challenge: | End-to-end task-oriented dialogue systems aim to generate system responses directly from plain text inputs. |
| Approach: | They propose a recurrent cell architecture which exploits the structural information in dialogue history . they propose recursive cell architecture to allow representation learning on graphs . |
| Outcome: | The proposed model improves on two different datasets on task-oriented dialogues. |
Topic-Aware Response Generation in Task-Oriented Dialogue with Unstructured Knowledge Access (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results indicate that TARG achieves state-of-the-art performance in knowledge selection and response generation, outperforming previous state- of-the art by 3.2, 3.6, and 4.2 points in EM, F1 and BLEU-4 respectively on Doc2Dial. |
| Approach: | They propose to integrate topical information into knowledge-grounded task-oriented dialogue systems by using multiple topic-aware attention mechanisms to derive the importance weighting scheme over dialogue utterances and external knowledge sources. |
| Outcome: | The proposed model outperforms existing models in knowledge selection and response generation. |
Joint Reasoning on Hybrid-knowledge sources for Task-Oriented Dialog (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing systems for task oriented dialog use knowledge present only in structured knowledge sources to generate responses. |
| Approach: | They propose a model that assumes that information is always present in a structured knowledge base . they also refine the model to take into account the fact that it can fuse information from structured and unstructured knowledge sources. |
| Outcome: | The proposed model is robust to perturbations to knowledge modality and can fuse information from structured and unstructured knowledge to generate responses. |
KETOD: Knowledge-Enriched Task-Oriented Dialogue (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies treat task-oriented dialogue and chit-chat as separate domains . a new dataset is created to integrate both types of dialogue into a single system . |
| Approach: | They propose to integrate task-oriented dialogue and knowledge-grounded chit-chat into a single model by using a dataset. |
| Outcome: | The proposed models improve the performance of knowledge-enriched dialogues while maintaining a competitive task-oriented dialog performance. |
Enhancing Dialogue Generation via Dynamic Graph Knowledge Aggregation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing graph neural networks (GNNs) teach message passing on a graph from text, resulting in a semantic gap between graph knowledge and text. |
| Approach: | They propose a framework to integrate external graph knowledge into chatbots by coagulating representations of both text and graph knowledge. |
| Outcome: | The proposed framework outperforms state-of-the-art (SOTA) baselines on dialogue generation. |
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue systems perform poorly on unseen topics due to limited topics covered in training data. |
| Approach: | They propose a language model that homogenizes different knowledge sources to a unified knowledge representation for knowledge-grounded dialogue generation tasks. |
| Outcome: | The proposed language model generalizes well across knowledge-grounded dialogue tasks. |
Graph-Based Knowledge Integration for Question Answering over Dialogue (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches for question answering over dialogue did not consider dialogue structure and background knowledge (e.g., relationships between speakers). |
| Approach: | They propose a method which organizes a dialogue as a "relational graph" and uses edges to represent relationships between entities to encode multi-relations knowledge for reasoning. |
| Outcome: | The proposed method is better at tackling complex questions requiring relational reasoning and defending adversarial attacks with distracting sentences. |
DyKgChat: Benchmarking Dialogue Generation Grounding on Dynamic Knowledge Graphs (D19-1)
Copied to clipboard
| Challenge: | Existing work has not shown that knowledge-grounded models can zero-shot adapt to updated, unseen knowledge graphs. |
| Approach: | They propose a task to apply dynamic knowledge graphs to neural conversation models . they propose 'dyKgChat' that selects an output from two networks at each time step . |
| Outcome: | The proposed model outperforms existing knowledge-grounded conversation models in evaluation metrics. |
Sequence-to-Sequence Learning for Task-oriented Dialogue with Dialogue State Representation (C18-1)
Copied to clipboard
| Challenge: | Existing pipeline models for task-oriented dialogue system require explicit modeling of dialogue states and hand-crafted action spaces to query domain-specific knowledge base. |
| Approach: | They propose a framework that leverages the advantages of classic pipeline and sequence-to-sequence models. |
| Outcome: | The proposed framework outperforms baseline models on automatic and human evaluation on a Stanford Multi-turn Multi-domain task-oriented dialogue dataset. |
Space Efficient Context Encoding for Non-Task-Oriented Dialogue Generation with Graph Attention Transformer (2021.acl-long)
Copied to clipboard
| Challenge: | Recent Transformer-based models aim to integrate fixed background context into non-task-oriented dialogue systems, but the context length is fixed in these architectures, which restricts how much background or dialogue context can be kept. |
| Approach: | They propose a more concise encoding for background context structured in the form of knowledge graphs by expressing the graph connections through restrictions on the attention weights. |
| Outcome: | The proposed architecture reduces space requirements without negative effects on the precision of reproduction of knowledge and perceived consistency. |