Bridging the Gap between Prior and Posterior Knowledge Selection for Knowledge-Grounded Dialogue Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue models lack prior and posterior knowledge selection . prior selection module may not learn to select knowledge properly because of lack of posterior information . |
| Approach: | They propose a knowledge distillation-based training strategy to remove the exposure bias of knowledge selection. |
| Outcome: | The proposed model improves on two knowledge-grounded dialogue datasets. |
Similar Papers
Well Begun is Half Done: Generator-agnostic Knowledge Pre-Selection for Knowledge-Grounded Dialogue (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge selection methods are costly to learn and difficult to interpret when errors arise in the generated responses. |
| Approach: | They propose a generator-agnostic knowledge selection method to select context-related knowledge among different knowledge structures and variable knowledge requirements. |
| Outcome: | The proposed method can select knowledge accurately in advance and reduce learning, adjustment, and interpretation burden of later models. |
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | Empirical results indicate that pre-trained language models can significantly outperform state-of-the-art methods in both automatic evaluation and human judgment. |
| Approach: | They propose to equip a pre-trained language model with a knowledge selection module to generate knowledge-grounded dialogues. |
| Outcome: | The proposed model outperforms state-of-the-art methods in evaluation and human judgment. |
Efficient Latent Variable Modeling for Knowledge-Grounded Dialogue Generation (2023.findings-emnlp)
Copied to clipboard
Gunsoo Han, Daejin Jo, Daniel Nam, Eunseop Yoon, Taehwan Kwon, Seungeun Rho, Kyoung-Woon On, Chang Yoo, Sungwoong Kim
| Challenge: | Existing knowledge-grounded dialogue generation algorithms require annotated knowledge to generate a response grounded on the retrieved knowledge. |
| Approach: | They propose an efficient algorithm for latent variable modeling that leverages large amount of dialogue data. |
| Outcome: | The proposed algorithm outperforms the supervised learning algorithm on knowledge-grounded dialogue datasets while maintaining efficiency and scalability. |
Unsupervised Knowledge Selection for Dialogue Generation (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge selection tasks require the preidentified knowledge to generate informative dialogues. |
| Approach: | They propose a novel method to supervise knowledge selection when the gold knowledge label is unknown by obtaining an oracle knowledge label via distant supervision and leverage knowledge distillation to alleviate the noisy labeling problem of distant supervision. |
| Outcome: | The proposed method outperforms strong supervised baselines on two knowledge-grounded dialogue datasets and generates more informative responses. |
Difference-aware Knowledge Selection for Knowledge-grounded Conversation Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge selection models are limited by the context, but the difference between selected knowledge at different turns is often overlooked. |
| Approach: | They propose a difference-aware knowledge selection method that computes the difference between the candidate knowledge sentences provided at the current turn and those chosen in the previous turns. |
| Outcome: | The proposed method outperforms the state-of-the-art methods in a knowledge-grounded dialog. |
Generative Knowledge Selection for Knowledge-Grounded Dialogues (2023.findings-eacl)
Copied to clipboard
| Challenge: | Knowledge selection is the key in knowledge-grounded dialogues (KGD), which aims to select an appropriate knowledge snippet to be used in the utterance based on dialogue history. |
| Approach: | They propose a generative approach for knowledge selection called GenKS that learns to select snippets by generating their identifiers with a sequence-to-sequence model. |
| Outcome: | The proposed approach captures intra-knowledge interaction inherently through attention mechanisms while generating their identifiers with a sequence-to-sequence model. |
A Pre-training Strategy for Zero-Resource Response Selection in Knowledge-Grounded Conversations (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to train retrieval-based dialogue systems rely on crowd-sourced data . however, it is difficult to collect large-scale dialogues that are grounded on background knowledge . |
| Approach: | They propose to decompose training of knowledge-grounded response selection into three tasks . they propose to combine query-passage matching task with query-dialogue history matching task . |
| Outcome: | Experimental results show that the proposed model can perform comparable to existing methods . the retrieval-based system can leverage background knowledge when conversing with humans . |
CoLV: A Collaborative Latent Variable Model for Knowledge-Grounded Dialogue Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to knowledge-grounded dialogue generation perform relatively independent sub-tasks . Typical approaches tend to decompose this task into two streamlined sub- tasks . |
| Approach: | They propose a collaborative latent variable model to integrate knowledge selection and knowledge-aware response generation simultaneously in separate but collaborative latences. |
| Outcome: | The proposed model outperforms previous methods on knowledge selection and response generation. |
There Is No Standard Answer: Knowledge-Grounded Dialogue Generation with Adversarial Activated Multi-Reference Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods emphasize selecting one golden knowledge given a particular dialogue context, overlooking the one-to-many phenomenon in dialogue. |
| Approach: | They propose to use a multi-reference dataset to assess the one-to-many efficacy of existing KGC models. |
| Outcome: | The proposed model improves the mapping relationship between multiple knowledge and multiple responses by optimizing the model in a wake-sleep style. |
Section-Aware Commonsense Knowledge-Grounded Dialogue Generation with Pre-trained Language Model (2022.coling-1)
Copied to clipboard
| Challenge: | Pre-trained language models can be expected to deepen the fusing of dialogue context and knowledge because of their superior ability of semantic understanding. |
| Approach: | They propose a two-stage framework to integrate a linearized knowledge into plan text using a ranking network PriorRanking to estimate the relevance of a retrieved knowledge fact. |
| Outcome: | The proposed framework improves the performance of pre-trained language models by using section-aware strategies to encode the linearized knowledge. |