Challenge: Hallucination is a significant barrier to the effective application of Large Language Models (LLMs).
Approach: They propose an Attention-Guided SElf-Reflection approach for hallucination detection in Large Language Models.
Outcome: The proposed method significantly outperforms existing methods in zero-shot hallucination detection on four widely-used LLMs across three different halluciation benchmarks.

Similar Papers

Zero-Resource Hallucination Prevention for Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for detecting hallucinations post-generation suffer from inconsistent performance due to the influence of instruction format and model style.
Approach: They propose a new technique that evaluates the model’s familiarity with the concepts present in the input instruction and withholding the generation of response in case of unfamiliar concepts under the zero-resource setting.
Outcome: The proposed technique shows superior performance across four different large language models and demonstrates that it can be used to mitigate hallucinations in LLMs.
InterrogateLLM: Zero-Resource Hallucination Detection in LLM-Generated Answers (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for detecting hallucinations in large language models are limited due to their high frequency and high accuracy.
Approach: They propose a method to detect hallucinations in large language models by repeating model-generated responses from its generated answer.
Outcome: The proposed method achieves 87% hallucinations in a specific experiment without external knowledge.
Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies on hallucination detection for LLMs focus on how to identify possible factrelated errors in outputs.
Approach: They propose an unsupervised training framework that leverages the internal states of LLMs for real-time hallucination detection without requiring manual annotations.
Outcome: The proposed framework outperforms existing state-of-the-art methods in hallucination detection.
Towards Mitigating LLM Hallucination via Self Reflection (2023.findings-emnlp)

Copied to clipboard

Challenge: Large language models have shown promise for generative and knowledge-intensive tasks including question-answering (QA) but the practical deployment still faces challenges, notably the issue of “hallucination”, where models generate plausible-sounding but unfaithful or nonsensical information.
Approach: They propose a self-reflection methodology that incorporates knowledge acquisition and answer generation to address the issue of "hallucination" they use a set of LLMs to generate a more accurate and factually accurate answer.
Outcome: The proposed approach improves factuality, consistency, and entailment of the generated answers.
Hallucination Detection in Structured Query Generation via LLM Self-Debating (2025.findings-emnlp)

Copied to clipboard

Challenge: Hallucination remains a key challenge in applying large language models to structured query generation . we propose the Self-Debating framework to enhance detection performance .
Approach: They propose a framework that prompts an LLM to generate contrastive explanations from opposing perspectives . they also propose 'self-debating' framework to enhance detection performance .
Outcome: The proposed framework outperforms LLM-as-a-Judge baselines in hallucination detection . the framework generates contrastive explanations from opposing perspectives .
The Troubling Emergence of Hallucination in Large Language Models - An Extensive Definition, Quantification, and Prescriptive Remediations (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models have generated widespread acclaim, but hallucination has also emerged as a by-product.
Approach: They propose a fine-grained discourse on profiling hallucination based on its degree, orientation, and category . they categorize hallucines into six types: acronym ambiguity, generated golem, virtual voice, geographic erratum, time wrap .
Outcome: The proposed method categorizes hallucination into six types based on their degree, orientation, and category .
ANAH: Analytical Annotation of Hallucinations in Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: a comprehensive and fine-grained measurement of the hallucination is crucial for LLMs' wide applications.
Approach: They propose a dataset that offers ANalytical Annotation of Hallucinations in Large Language Models.
Outcome: The proposed dataset can be used to train and evaluate hallucination annotators.
Tutorial Proposal: Hallucination in Large Language Models (2024.lrec-tutorials)

Copied to clipboard

Challenge: Grasping the intricacies of hallucination in LLMs can be daunting, especially for those new to the field.
Approach: This tutorial aims to bridge the gap between the field and the field of hallucination . it will explore the key aspects of hallucinonation, including benchmarking, detection, and mitigation techniques .
Outcome: This tutorial will explore the key aspects of hallucination in LLMs . it will also explore the specific constraints and shortcomings of current approaches .
Hallucination Diversity-Aware Active Learning for Text Summarization (2024.naacl-long)

Copied to clipboard

Challenge: Existing methods for alleviating hallucinations require costly human annotations . Existing approaches focus on a specific type of hallucinism, which limits their effectiveness .
Approach: They propose a method to detect hallucinations from errors in semantic frame, discourse and content verifiability in LLM summarization using HAllucination Diversity-Aware Sampling.
Outcome: The proposed framework reduces the need for costly human annotations to correct hallucinations in LLM outputs.
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: a growing number of researchers are studying the hallucination issue in large language models.
Approach: They propose a hallucination detection benchmark and a method to detect hallucines in LLMs.
Outcome: The proposed method detects hallucinations and mitigates them using different training stages.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations