Challenge: Knowledge-based open-domain dialogue generation aims to build chit-chat systems that talk to humans using mined support knowledge.
Approach: They propose a benchmark for evaluating multi-source dialogue knowledge selection and response generation using Wikipedia's wizard of Wikipedia.
Outcome: The proposed benchmark is called multi-source Wizard of Wikipedia (Ms.WoW) it contains clean support knowledge, grounded at the utterance level and partitioned into multiple knowledge sources.

Similar Papers

Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation (2022.naacl-main)

Copied to clipboard

Challenge: Existing knowledge-grounded dialogue systems perform poorly on unseen topics due to limited topics covered in training data.
Approach: They propose a language model that homogenizes different knowledge sources to a unified knowledge representation for knowledge-grounded dialogue generation tasks.
Outcome: The proposed language model generalizes well across knowledge-grounded dialogue tasks.
More is Better: Enhancing Open-Domain Dialogue Generation via Multi-Source Heterogeneous Knowledge (2021.emnlp-main)

Copied to clipboard

Challenge: Existing knowledge-enhanced methods use a single-source homogeneous knowledge base with limited knowledge coverage.
Approach: They propose a multi-source heterogeneous knowledge-enhanced dialogue generation model that leverages multiple knowledge sources to improve knowledge coverage.
Outcome: The proposed model outperforms existing knowledge-enhanced models on a Chinese dataset and shows that it can leverage multiple heterogeneous knowledge sources to improve knowledge coverage.
Multi-Source Multi-Type Knowledge Exploration and Exploitation for Dialogue Generation (2023.emnlp-main)

Copied to clipboard

Challenge: Existing models focus on identifying specific types of dialogue knowledge and utilizing corresponding datasets for training, but lack generalization capabilities and computational resources.
Approach: They propose a framework that explores multi-source multi-type knowledge from LLMs by leveraging diverse datasets and exploits it for response generation.
Outcome: The proposed framework exploits multi-source multi-type knowledge from LLMs to generate coherent, informative, and fluent responses.
A Model of Cross-Lingual Knowledge-Grounded Response Generation for Open-Domain Dialogue Systems (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing studies on open-domain dialogue systems that allow free topics are challenging . however, non-English dialogue systems suffer from reproducing the performance of English dialogue systems .
Approach: They propose to use English knowledge to improve the performance of open-domain dialogue systems . they construct a Korean-English T5 language model and develop a knowledge-grounded Korean dialogue model .
Outcome: The proposed model improves even when only English knowledge is given . the model is built with a pre-trained language model and a knowledge-grounded Korean dialogue model .
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models (2020.emnlp-main)

Copied to clipboard

Challenge: Empirical results indicate that pre-trained language models can significantly outperform state-of-the-art methods in both automatic evaluation and human judgment.
Approach: They propose to equip a pre-trained language model with a knowledge selection module to generate knowledge-grounded dialogues.
Outcome: The proposed model outperforms state-of-the-art methods in evaluation and human judgment.
Grounding in social media: An approach to building a chit-chat dialogue model (2022.naacl-srw)

Copied to clipboard

Challenge: Existing open-domain dialogue models fail to capture and utilize external knowledge, leading to repetitive or generic responses to unseen utterances.
Approach: They propose to use social media comments to improve the raw conversation ability of open-domain dialogue systems.
Outcome: The proposed model improves the raw conversation ability of open-domain dialogue systems by mimicking human responses through casual interactions found on social media.
Exploring the Effectiveness of Multi-Lingual Commonsense Knowledge-Aware Open-Domain Dialogue Response Generation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have shown that commonsense knowledge-aware models can improve informativeness while reducing the hallucination issue.
Approach: They propose a task to use commonsense knowledge in other languages to enhance the current dialogue generation by using commonsensical knowledge in different languages.
Outcome: The proposed model improves the current dialogue generation while reducing the hallucination issue.
Pan More Gold from the Sand: Refining Open-domain Dialogue Training with Noisy Self-Retrieval Generation (2022.coling-1)

Copied to clipboard

Challenge: Existing methods for generating open-domain dialogue systems underutilize training data.
Approach: They propose a retrieval-generation training framework that takes advantage of heterogeneous training data by considering them as "evidence" they use BERTScore retrieval framework which gives better qualities of the training data, they show .
Outcome: The proposed method performs well on zero-shot experiments and is more robust to real-world data.
Plug-and-Play Conversational Models (2020.findings-emnlp)

Copied to clipboard

Challenge: Large conversational models that generate coherent and fluent responses often require large dialogue datasets.
Approach: They propose and evaluate plug-and-play methods for controllable response generation . they demonstrate a high degree of control over the generated conversational responses .
Outcome: The proposed method does not require further computation at decoding time and does not need fine-tuning of a large language model.
Generating Dialogue Responses from a Semantic Latent Space (2020.emnlp-main)

Copied to clipboard

Challenge: Existing models for dialogue generation are unable to integrate information from multiple semantically similar valid responses of a given prompt.
Approach: They propose to learn the pair relationship between the prompts and responses as a regression task instead of the end-to-end classification on vocabulary.
Outcome: The proposed model learns the pair relationship between the prompts and responses on a latent space instead of the end-to-end classification on vocabulary.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations