Challenge: Existing work on sequence-to-sequence dialogues treats the KB query as an attention over the entire KB without the guarantee that the generated entities are consistent with each other.
Approach: They propose a framework which queries the knowledge base in two steps to improve consistency . they first return the most relevant KB row given a dialogue history .
Outcome: The proposed framework outperforms baseline models and produces entity-consistent responses.

Similar Papers

Retrieval-Generation Alignment for End-to-End Task-Oriented Dialogue System (2023.emnlp-main)

Copied to clipboard

Challenge: generative models struggle to distinguish subtle differences among retrieved knowledge records, resulting in suboptimal quality of generated responses.
Approach: They propose to use maximum marginal likelihood to train a perceptive retriever by utilizing signals from response generation for supervision.
Outcome: The proposed approach improves on three task-oriented dialogue datasets using T5 and ChatGPT as the backbone models.
Autoregressive Entity Generation for End-to-End Task-Oriented Dialog (2022.coling-1)

Copied to clipboard

Challenge: Task-oriented dialog systems require external knowledge base to generate a response . current systems require scanning the KB at each turn, which is inefficient when the kb scales up .
Approach: They propose to generate entity autoregressively before leveraging it to guide response generation.
Outcome: Experiments on MultiWOZ 2.1 single and CAMREST show that the proposed system generates more high-quality and entity-consistent responses in an end-to-end manner.
Constraint based Knowledge Base Distillation in End-to-End Task Oriented Dialogs (2021.findings-acl)

Copied to clipboard

Challenge: Existing methods for learning task-oriented dialog systems filter irrelevant KB information over a large KB.
Approach: They propose a pairwise similarity filter that respects the n-ary structure in a KB record and an auxiliary loss that helps in separating contextually unrelated KB information.
Outcome: The proposed method outperforms existing state-of-the-art models on three publicly available datasets.
Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systems (2020.findings-emnlp)

Copied to clipboard

Challenge: End-to-end systems rely on dialogue state tracking and annotations to fulfill user requests . modularized systems require multiple steps, including a direct interaction with the KB .
Approach: They propose a method to embed the KB directly into the model parameters . they evaluate five task-oriented dialogue datasets with small, medium, and large KBs .
Outcome: The proposed model can embed the KB directly into the model parameters without any DST or template responses, nor the kb as input.
Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialog (2023.acl-long)

Copied to clipboard

Challenge: Existing systems blend knowledge retrieval with response generation and optimize them with direct supervision from reference responses.
Approach: They propose a multi-grained knowledge retrieval system that decouples knowledge retrievals from response generation and introduces an entity selector and an attribute selector to acquire multigrained information from the knowledge base.
Outcome: The proposed system performs better on small and large knowledge bases.
GraphDialog: Integrating Graph Knowledge into End-to-End Task-Oriented Dialogue Systems (2020.emnlp-main)

Copied to clipboard

Challenge: End-to-end task-oriented dialogue systems aim to generate system responses directly from plain text inputs.
Approach: They propose a recurrent cell architecture which exploits the structural information in dialogue history . they propose recursive cell architecture to allow representation learning on graphs .
Outcome: The proposed model improves on two different datasets on task-oriented dialogues.
Sequence-to-Sequence Learning for Task-oriented Dialogue with Dialogue State Representation (C18-1)

Copied to clipboard

Challenge: Existing pipeline models for task-oriented dialogue system require explicit modeling of dialogue states and hand-crafted action spaces to query domain-specific knowledge base.
Approach: They propose a framework that leverages the advantages of classic pipeline and sequence-to-sequence models.
Outcome: The proposed framework outperforms baseline models on automatic and human evaluation on a Stanford Multi-turn Multi-domain task-oriented dialogue dataset.
Contextualize Knowledge Bases with Transformer for End-to-end Task-Oriented Dialogue Systems (2021.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to integrate knowledge bases into end-to-end task-oriented dialogue systems are limited in their ability to properly represent the entity of KB.
Approach: They propose a framework that dynamically perceives all relevant entities and dialogue history . it uses a Memory Mask to enforce the entity to focus on its relevant entities .
Outcome: The proposed framework can achieve superior performance over the state of the arts.
Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systems (P18-1)

Copied to clipboard

Challenge: End-to-end task-oriented dialog systems often suffer from the challenge of incorporating knowledge bases.
Approach: They propose a novel yet simple end-to-end differentiable model called memory-tosequence to address this issue.
Outcome: The proposed model can be trained faster and achieve state-of-the-art performance on three different task-oriented dialog datasets.
Dual-Feedback Knowledge Retrieval for Task-Oriented Dialogue Systems (2023.emnlp-main)

Copied to clipboard

Challenge: Current approaches to task-oriented dialogue systems integrate knowledge retrieval and response generation, which poses scalability challenges when dealing with extensive knowledge bases.
Approach: They propose a retriever-generator architecture that harnesses a retrieval and a generator to generate system responses by using feedback from the generator as pseudo-labels.
Outcome: The proposed architecture shows superior performance on three benchmark datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations