Retrieval Augmentation Reduces Hallucination in Conversation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | State-of-the-art dialogue models suffer from factual incorrectness and hallucination of knowledge. |
| Approach: | They propose to use neural-retrieval-in-the-loop architectures to optimize knowledge-grounded dialogue by retrieving, ranking, and encoder-decoders. |
| Outcome: | The proposed architectures exhibit open-domain conversational capabilities and generalize effectively to scenarios not within the training data. |
Similar Papers
Towards Fewer Hallucinations in Knowledge-Grounded Dialogue Generation via Augmentative and Contrastive Knowledge-Dialogue (2023.acl-short)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue generation models face the hallucination problem . Existing models generate inappropriate knowledge and generate inconsistent responses . |
| Approach: | They propose an Augmentative and Contrastive Knowledge Dialogue Expansion Framework to enhance existing knowledge dialogue models by polarizing optimization objectives and weak knowledge generation ability. |
| Outcome: | The proposed framework expands existing training sets and smooths the optimization objective that enables models to generate ground-truth with or without gold knowledge. |
RHO: Reducing Hallucination in Open-domain Dialogues with Knowledge Grounding (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue systems generate accurate and informative responses, but they are prone to hallucination problems. |
| Approach: | They propose a method to generate hallucinated responses using knowledge graphs . they propose local knowledge grounding to combine textual embeddings with corresponding KG embeddments . a global knowledge ground technique is also proposed to equip RHO with multi-hop reasoning abilities . |
| Outcome: | The proposed approach outperforms state-of-the-art methods on automatic and human evaluation by a large margin. |
Diving Deep into Modes of Fact Hallucinations in Dialogue Systems (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Knowledge Graph(KG) grounded conversations often use large pre-trained models and suffer from fact hallucination. |
| Approach: | They propose to use a human feedback analysis to identify various modes of hallucination in KG chatbots. |
| Outcome: | The proposed system provides fine-grained signals that control fallacious content while generating responses. |
You Truly Understand What I Need : Intellectual and Friendly Dialog Agents grounding Persona and Knowledge (2022.findings-emnlp)
Copied to clipboard
Jungwoo Lim, Myunghoon Kang, Yuna Hur, Seung Won Jeong, Jinsung Kim, Yoonna Jang, Dongyub Lee, Hyesung Ji, DongHoon Shin, Seungryong Kim, Heuiseok Lim
| Challenge: | Existing models that ground knowledge and persona at the same time are limited, leading to hallucination and a passive way of using personas. |
| Approach: | They propose a conversational agent that grounds external knowledge and persona simultaneously and a retrieval augmented generation model that generates utterances with lesser hallucination and more engagingness. |
| Outcome: | The proposed agent generates the utterance with lesser hallucination and more engagingness utilizing retrieval augmented generation with knowledge-persona enhanced query. |
On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models? (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing knowledge-grounded conversational benchmarks produce factually invalid statements, a phenomenon commonly called hallucination. |
| Approach: | They conduct a human study on knowledge-grounded conversational benchmarks and state-of-the-art models. |
| Outcome: | The findings raise important questions on the quality of existing datasets and models. |
Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding (2021.emnlp-main)
Copied to clipboard
| Challenge: | Dialogue systems that generate factually incorrect responses are often unfitful and hallucinate factuality invalid. |
| Approach: | They propose a method to improve faithfulness and reduce hallucination of neural dialogue systems to known facts supplied by a Knowledge Graph. |
| Outcome: | The proposed approach improves faithfulness and reduces hallucination of dialogue systems to known facts . it leverages a token-level fact critic to identify plausible sources of hallucinism . |
A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing dialogue systems have demonstrated impressive performance conducting fluent and natural-sounding conversations, but they are plagued by the Knowledge Hallucination problem. |
| Approach: | They propose a method that exploits the dialogue-knowledge interaction to reduce hallucination by using external knowledge resources to generate more informative responses. |
| Outcome: | The proposed method reduces hallucination without disrupting other dialogue performance while keeping adaptive to different generation models. |
Citation-Enhanced Generation for LLM-based Chatbots (2024.acl-long)
Copied to clipboard
| Challenge: | Existing efforts to alleviate hallucination in chatbots require additional training and data annotation. |
| Approach: | They propose a Citation-Enhanced Generation approach that uses retrieval argumentation to generate citations and a natural language inference-based citation generation module to generate content. |
| Outcome: | The proposed method outperforms state-of-the-art methods on three benchmarks. |
Elastic Weight Removal for Faithful and Abstractive Dialogue Generation (2024.naacl-long)
Copied to clipboard
| Challenge: | Current-day large language models generate coherent, grammatical, and seemingly meaningful text, but are prone to hallucinating incorrect information. |
| Approach: | They propose to ‘subtract’ parameters of a model trained to hallucinate from a dialogue response generation model to ‘negate’ the contribution of such hallucinatedexamples from it. |
| Outcome: | The proposed method reduces hallucinations and discourages extractive responses, which are often a consequence of reducing hallucines by encouraging copy-pasting of document spans. |
RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to personalized dialogue generation rely on dialogue data paired with user traits, profiles or persona description sentences. |
| Approach: | They propose a hierarchical transformer retriever trained on dialogue domain data to perform personalized retrieval and a context-aware prefix encoder that fuses the retrieved information to the decoder more effectively. |
| Outcome: | The proposed model generates more fluent and personalized responses under a suite of human and automatic metrics and is superior to state-of-the-art baselines on English Reddit conversations. |