RHO: Reducing Hallucination in Open-domain Dialogues with Knowledge Grounding (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue systems generate accurate and informative responses, but they are prone to hallucination problems. |
| Approach: | They propose a method to generate hallucinated responses using knowledge graphs . they propose local knowledge grounding to combine textual embeddings with corresponding KG embeddments . a global knowledge ground technique is also proposed to equip RHO with multi-hop reasoning abilities . |
| Outcome: | The proposed approach outperforms state-of-the-art methods on automatic and human evaluation by a large margin. |
Similar Papers
Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding (2021.emnlp-main)
Copied to clipboard
| Challenge: | Dialogue systems that generate factually incorrect responses are often unfitful and hallucinate factuality invalid. |
| Approach: | They propose a method to improve faithfulness and reduce hallucination of neural dialogue systems to known facts supplied by a Knowledge Graph. |
| Outcome: | The proposed approach improves faithfulness and reduces hallucination of dialogue systems to known facts . it leverages a token-level fact critic to identify plausible sources of hallucinism . |
A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing dialogue systems have demonstrated impressive performance conducting fluent and natural-sounding conversations, but they are plagued by the Knowledge Hallucination problem. |
| Approach: | They propose a method that exploits the dialogue-knowledge interaction to reduce hallucination by using external knowledge resources to generate more informative responses. |
| Outcome: | The proposed method reduces hallucination without disrupting other dialogue performance while keeping adaptive to different generation models. |
Towards Fewer Hallucinations in Knowledge-Grounded Dialogue Generation via Augmentative and Contrastive Knowledge-Dialogue (2023.acl-short)
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue generation models face the hallucination problem . Existing models generate inappropriate knowledge and generate inconsistent responses . |
| Approach: | They propose an Augmentative and Contrastive Knowledge Dialogue Expansion Framework to enhance existing knowledge dialogue models by polarizing optimization objectives and weak knowledge generation ability. |
| Outcome: | The proposed framework expands existing training sets and smooths the optimization objective that enables models to generate ground-truth with or without gold knowledge. |
Retrieval Augmentation Reduces Hallucination in Conversation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | State-of-the-art dialogue models suffer from factual incorrectness and hallucination of knowledge. |
| Approach: | They propose to use neural-retrieval-in-the-loop architectures to optimize knowledge-grounded dialogue by retrieving, ranking, and encoder-decoders. |
| Outcome: | The proposed architectures exhibit open-domain conversational capabilities and generalize effectively to scenarios not within the training data. |
Diving Deep into Modes of Fact Hallucinations in Dialogue Systems (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Knowledge Graph(KG) grounded conversations often use large pre-trained models and suffer from fact hallucination. |
| Approach: | They propose to use a human feedback analysis to identify various modes of hallucination in KG chatbots. |
| Outcome: | The proposed system provides fine-grained signals that control fallacious content while generating responses. |
Elastic Weight Removal for Faithful and Abstractive Dialogue Generation (2024.naacl-long)
Copied to clipboard
| Challenge: | Current-day large language models generate coherent, grammatical, and seemingly meaningful text, but are prone to hallucinating incorrect information. |
| Approach: | They propose to ‘subtract’ parameters of a model trained to hallucinate from a dialogue response generation model to ‘negate’ the contribution of such hallucinatedexamples from it. |
| Outcome: | The proposed method reduces hallucinations and discourages extractive responses, which are often a consequence of reducing hallucines by encouraging copy-pasting of document spans. |
Grounding in social media: An approach to building a chit-chat dialogue model (2022.naacl-srw)
Copied to clipboard
| Challenge: | Existing open-domain dialogue models fail to capture and utilize external knowledge, leading to repetitive or generic responses to unseen utterances. |
| Approach: | They propose to use social media comments to improve the raw conversation ability of open-domain dialogue systems. |
| Outcome: | The proposed model improves the raw conversation ability of open-domain dialogue systems by mimicking human responses through casual interactions found on social media. |
You Truly Understand What I Need : Intellectual and Friendly Dialog Agents grounding Persona and Knowledge (2022.findings-emnlp)
Copied to clipboard
Jungwoo Lim, Myunghoon Kang, Yuna Hur, Seung Won Jeong, Jinsung Kim, Yoonna Jang, Dongyub Lee, Hyesung Ji, DongHoon Shin, Seungryong Kim, Heuiseok Lim
| Challenge: | Existing models that ground knowledge and persona at the same time are limited, leading to hallucination and a passive way of using personas. |
| Approach: | They propose a conversational agent that grounds external knowledge and persona simultaneously and a retrieval augmented generation model that generates utterances with lesser hallucination and more engagingness. |
| Outcome: | The proposed agent generates the utterance with lesser hallucination and more engagingness utilizing retrieval augmented generation with knowledge-persona enhanced query. |
Mitigating Hallucination by Integrating Knowledge Graphs into LLM Inference – a Systematic Literature Review (2025.acl-srw)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have made significant progress on different language tasks, but they tend to "hallucinate" plausible but factually incorrect answers. |
| Approach: | They propose to integrate knowledge graphs (KGs) into LLM inference to reduce hallucinations by searching online and applying a selection process. |
| Outcome: | The proposed integration improves performance on benchmark datasets and also to mitigate hallucinations. |
Post-hoc Utterance Refining Method by Entity Mining for Faithful Knowledge Grounded Conversations (2023.emnlp-main)
Copied to clipboard
Yoonna Jang, Suhyune Son, Jeongwoo Lee, Junyoung Son, Yuna Hur, Jungwoo Lim, Hyeonseok Moon, Kisu Yang, Heuiseok Lim
| Challenge: | Despite advances in language generation, models suffer from hallucinations that are either untrue or unfaithful to a given source. |
| Approach: | They propose a method to refine hallucinated utterances based on source knowledge . REM implicitly uses key entities in the knowledge to refine the utterant . |
| Outcome: | The proposed method reduces entity hallucination in the generated utterance and improves the quality of the model. |