Challenge: Knowledge Graph(KG) grounded conversations often use large pre-trained models and suffer from fact hallucination.
Approach: They propose to use a human feedback analysis to identify various modes of hallucination in KG chatbots.
Outcome: The proposed system provides fine-grained signals that control fallacious content while generating responses.

Similar Papers

On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models? (2022.naacl-main)

Copied to clipboard

Challenge: Existing knowledge-grounded conversational benchmarks produce factually invalid statements, a phenomenon commonly called hallucination.
Approach: They conduct a human study on knowledge-grounded conversational benchmarks and state-of-the-art models.
Outcome: The findings raise important questions on the quality of existing datasets and models.
Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding (2021.emnlp-main)

Copied to clipboard

Challenge: Dialogue systems that generate factually incorrect responses are often unfitful and hallucinate factuality invalid.
Approach: They propose a method to improve faithfulness and reduce hallucination of neural dialogue systems to known facts supplied by a Knowledge Graph.
Outcome: The proposed approach improves faithfulness and reduces hallucination of dialogue systems to known facts . it leverages a token-level fact critic to identify plausible sources of hallucinism .
A Cause-Effect Look at Alleviating Hallucination of Knowledge-grounded Dialogue Generation (2024.lrec-main)

Copied to clipboard

Challenge: Existing dialogue systems have demonstrated impressive performance conducting fluent and natural-sounding conversations, but they are plagued by the Knowledge Hallucination problem.
Approach: They propose a method that exploits the dialogue-knowledge interaction to reduce hallucination by using external knowledge resources to generate more informative responses.
Outcome: The proposed method reduces hallucination without disrupting other dialogue performance while keeping adaptive to different generation models.
RHO: Reducing Hallucination in Open-domain Dialogues with Knowledge Grounding (2023.findings-acl)

Copied to clipboard

Challenge: Existing knowledge-grounded dialogue systems generate accurate and informative responses, but they are prone to hallucination problems.
Approach: They propose a method to generate hallucinated responses using knowledge graphs . they propose local knowledge grounding to combine textual embeddings with corresponding KG embeddments . a global knowledge ground technique is also proposed to equip RHO with multi-hop reasoning abilities .
Outcome: The proposed approach outperforms state-of-the-art methods on automatic and human evaluation by a large margin.
Retrieval Augmentation Reduces Hallucination in Conversation (2021.findings-emnlp)

Copied to clipboard

Challenge: State-of-the-art dialogue models suffer from factual incorrectness and hallucination of knowledge.
Approach: They propose to use neural-retrieval-in-the-loop architectures to optimize knowledge-grounded dialogue by retrieving, ranking, and encoder-decoders.
Outcome: The proposed architectures exhibit open-domain conversational capabilities and generalize effectively to scenarios not within the training data.
Hallucination Detection in Long-Form Text Generated by LLMs: A Benchmark and a Hyper-Relational Knowledge Graph Approach (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for hallucination detection are coarse-grained and lack long-range consistency checks.
Approach: They propose a benchmark for long-form hallucination detection that incorporates diverse entity types and intricate factual dependencies spanning extended contexts.
Outcome: The proposed framework outperforms baselines and robustly integrates fact-centric hyper-relational knowledge graphs.
On Large Language Models’ Hallucination with Regard to Known Facts (2024.naacl-long)

Copied to clipboard

Challenge: Large language models are successful in answering factoid questions but are also prone to hallucination.
Approach: They propose self-reporting to the model when faced with such limitations.
Outcome: The proposed classifier can detect hallucinations with an 88% success rate and can be used to answer factoid questions with correct answer knowledge.
Towards Fewer Hallucinations in Knowledge-Grounded Dialogue Generation via Augmentative and Contrastive Knowledge-Dialogue (2023.acl-short)

Copied to clipboard

Challenge: Existing knowledge-grounded dialogue generation models face the hallucination problem . Existing models generate inappropriate knowledge and generate inconsistent responses .
Approach: They propose an Augmentative and Contrastive Knowledge Dialogue Expansion Framework to enhance existing knowledge dialogue models by polarizing optimization objectives and weak knowledge generation ability.
Outcome: The proposed framework expands existing training sets and smooths the optimization objective that enables models to generate ground-truth with or without gold knowledge.
Hallucinated but Factual! Inspecting the Factuality of Hallucinations in Abstractive Summarization (2022.acl-long)

Copied to clipboard

Challenge: State-of-the-art abstractive summarization systems often generate hallucinations, i.e., content that is not directly inferable from the source document.
Approach: They propose a detection approach that separates factual from non-factual hallucinations of entities by masked language models.
Outcome: The proposed method outperforms baselines in accuracy and F1 scores and has a strong correlation with human judgments on factuality classification tasks.
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: a growing number of researchers are studying the hallucination issue in large language models.
Approach: They propose a hallucination detection benchmark and a method to detect hallucines in LLMs.
Outcome: The proposed method detects hallucinations and mitigates them using different training stages.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations