Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue systems perform poorly on unseen topics due to limited topics covered in training data. |
| Approach: | They propose a language model that homogenizes different knowledge sources to a unified knowledge representation for knowledge-grounded dialogue generation tasks. |
| Outcome: | The proposed language model generalizes well across knowledge-grounded dialogue tasks. |
Similar Papers
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | Empirical results indicate that pre-trained language models can significantly outperform state-of-the-art methods in both automatic evaluation and human judgment. |
| Approach: | They propose to equip a pre-trained language model with a knowledge selection module to generate knowledge-grounded dialogues. |
| Outcome: | The proposed model outperforms state-of-the-art methods in evaluation and human judgment. |
A Synthetic Data Generation Framework for Grounded Dialogues (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to train grounded dialogues require large amounts of data. |
| Approach: | They propose a synthetic data generation framework for grounded dialogues that takes knowledge data and heuristics to determine a dialogue flow and incrementally turn it into a dialog. |
| Outcome: | The proposed framework significantly boosts model performance in training data and low-resource scenarios. |
Efficient Latent Variable Modeling for Knowledge-Grounded Dialogue Generation (2023.findings-emnlp)
Copied to clipboard
Gunsoo Han, Daejin Jo, Daniel Nam, Eunseop Yoon, Taehwan Kwon, Seungeun Rho, Kyoung-Woon On, Chang Yoo, Sungwoong Kim
| Challenge: | Existing knowledge-grounded dialogue generation algorithms require annotated knowledge to generate a response grounded on the retrieved knowledge. |
| Approach: | They propose an efficient algorithm for latent variable modeling that leverages large amount of dialogue data. |
| Outcome: | The proposed algorithm outperforms the supervised learning algorithm on knowledge-grounded dialogue datasets while maintaining efficiency and scalability. |
Eliciting Knowledge from Large Pre-Trained Models for Unsupervised Knowledge-Grounded Conversation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large-scale pre-training provide large models with the potential to learn knowledge from the raw text. |
| Approach: | They propose a posterior-based reweighing and noisy training strategy to exploit generated knowledge in dialogue generation. |
| Outcome: | Empirical results show that the proposed methods outperform the state-of-the-art methods in unsupervised knowledge-grounded conversation. |
Enhancing Knowledge Retrieval with Topic Modeling for Knowledge-Grounded Dialogue (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to knowledge retrieval are limited by the knowledge base encoder, but our work focuses on the knowledge-base encoder. |
| Approach: | They propose an approach that utilizes topic modeling on the knowledge base to improve retrieval accuracy and as a result, improve response generation. |
| Outcome: | The proposed approach can improve retrieval and generation performance on two datasets. |
A Knowledge Plug-and-Play Test Bed for Open-domain Dialogue Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Knowledge-based open-domain dialogue generation aims to build chit-chat systems that talk to humans using mined support knowledge. |
| Approach: | They propose a benchmark for evaluating multi-source dialogue knowledge selection and response generation using Wikipedia's wizard of Wikipedia. |
| Outcome: | The proposed benchmark is called multi-source Wizard of Wikipedia (Ms.WoW) it contains clean support knowledge, grounded at the utterance level and partitioned into multiple knowledge sources. |
PEK: A Parameter-Efficient Framework for Knowledge-Grounded Dialogue Generation (2024.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models have shown great dialogue generation capability in different scenarios, but the huge VRAM consumption when fine-tuning them is one of their drawbacks. |
| Approach: | They propose a parameter-efficient framework for knowledge-enhanced dialogue generation that leverages external knowledge documents and knowledge graphs to enhance its generation capabilities. |
| Outcome: | The proposed framework outperforms baseline methods on multiple evaluation metrics on Wizard of Wikipedia and CMU_DoG datasets. |
A Model of Cross-Lingual Knowledge-Grounded Response Generation for Open-Domain Dialogue Systems (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on open-domain dialogue systems that allow free topics are challenging . however, non-English dialogue systems suffer from reproducing the performance of English dialogue systems . |
| Approach: | They propose to use English knowledge to improve the performance of open-domain dialogue systems . they construct a Korean-English T5 language model and develop a knowledge-grounded Korean dialogue model . |
| Outcome: | The proposed model improves even when only English knowledge is given . the model is built with a pre-trained language model and a knowledge-grounded Korean dialogue model . |
A Pre-training Strategy for Zero-Resource Response Selection in Knowledge-Grounded Conversations (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to train retrieval-based dialogue systems rely on crowd-sourced data . however, it is difficult to collect large-scale dialogues that are grounded on background knowledge . |
| Approach: | They propose to decompose training of knowledge-grounded response selection into three tasks . they propose to combine query-passage matching task with query-dialogue history matching task . |
| Outcome: | Experimental results show that the proposed model can perform comparable to existing methods . the retrieval-based system can leverage background knowledge when conversing with humans . |
Augmenting Knowledge-grounded Conversations with Sequential Knowledge Transition (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue models lack fine-grained control over knowledge selection and integration with dialogues. |
| Approach: | They propose to explicitly model the knowledge transition in sequential multi-turn conversations by abstracting knowledge into topic tags. |
| Outcome: | The proposed model outperforms baseline models on knowledge-grounded dialogue benchmarks. |