Enhancing Uncertainty-Based Hallucination Detection with Stronger Focus (2023.emnlp-main)
Copied to clipboard
Tianhang Zhang, Lin Qiu, Qipeng Guo, Cheng Deng, Yue Zhang, Zheng Zhang, Chenghu Zhou, Xinbing Wang, Luoyi Fu
| Challenge: | Existing methods for detecting hallucinations in LLMs rely on external knowledge for reference retrieval or require sampling multiple responses for consistency verification. |
| Approach: | They propose a reference-free, uncertainty-based method for detecting hallucinations in Large Language Models that imitates human focus in factuality checking from three aspects: focus on the most informative keywords; focus on unreliable tokens in historical context; focus of token properties such as token type and token frequency. |
| Outcome: | The proposed method achieves state-of-the-art performance across all evaluation metrics and eliminates the need for additional information. |
Similar Papers
Reference-free Hallucination Detection for Large Vision-Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large vision-language models exhibit excellent ability in language understanding, question answering, and conversations of visual inputs, but they are prone to producing hallucinations. |
| Approach: | They propose to use supervised uncertainty quantification methods to detect hallucinations in large vision-language models. |
| Outcome: | The proposed methods outperform the others in detecting hallucinations on four representative LVLMs across two different tasks. |
Simple Factuality Probes Detect Hallucinations in Long-Form Natural Language Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to detect hallucination require many samples from the LLM generator . current methods require multiple samples, which is computationally infeasible . |
| Approach: | They propose a simple baseline for detecting hallucinations in long-form LLM generations . they show that LLM hidden states are highly predictive of factuality in long form natural language generation . |
| Outcome: | The proposed method is comparable to expensive multi-sample approaches while drawing only a single sample from the LLM generator. |
Detecting Hallucinations in Large Language Models via Internal Attention Divergence Signals (2026.acl-srw)
Copied to clipboard
| Challenge: | Existing methods conflate fluency with correctness or require substantial computational overhead. |
| Approach: | They propose a single-pass uncertainty quantification method that uses attention matrices to estimate uncertainty without requiring repeated sampling or external models. |
| Outcome: | The proposed method performs well across multiple datasets, task types, and model families and is highly predictive of answer correctness. |
Fact-Checking the Output of Large Language Models via Token-Level Uncertainty Quantification (2024.findings-acl)
Copied to clipboard
Ekaterina Fadeeva, Aleksandr Rubashevskii, Artem Shelmanov, Sergey Petrakov, Haonan Li, Hamdy Mubarak, Evgenii Tsymbalov, Gleb Kuzmin, Alexander Panchenko, Timothy Baldwin, Preslav Nakov, Maxim Panov
| Challenge: | Large language models are notorious for producing erroneous claims in their output. |
| Approach: | They propose a fact-checking and hallucination detection pipeline based on token-level uncertainty quantification that removes the impact of uncertainty about what claim to generate on the current step and what surface form to use. |
| Outcome: | The proposed method can fact-check the atomic claims in the output of large language models. |
Principled Detection of Hallucinations in Large Language Models via Multiple Testing (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to detect hallucinations are prone to generating false alarms and false feedbacks. |
| Approach: | They propose a method that aggregates multiple evaluation scores via conformal p-values, enabling calibrated detection with controlled false alarm rate. |
| Outcome: | The proposed method aggregates multiple evaluation scores via conformal p-values, enabling calibrated detection with controlled false alarm rate. |
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | a growing number of researchers are studying the hallucination issue in large language models. |
| Approach: | They propose a hallucination detection benchmark and a method to detect hallucines in LLMs. |
| Outcome: | The proposed method detects hallucinations and mitigates them using different training stages. |
Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on hallucination detection for LLMs focus on how to identify possible factrelated errors in outputs. |
| Approach: | They propose an unsupervised training framework that leverages the internal states of LLMs for real-time hallucination detection without requiring manual annotations. |
| Outcome: | The proposed framework outperforms existing state-of-the-art methods in hallucination detection. |
Fine-Grained Detection of Context-Grounded Hallucinations Using LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing representations of hallucinations limit the types of errors that can be expressed, so we propose a new representation based on free-form textual descriptions, capturing the full range of possible errors. |
| Approach: | They propose a benchmark for localizing hallucinations using LLMs with a human annotation of over 1,000 examples and a protocol to verify its quality in a humans evaluation. |
| Outcome: | The proposed representation captures the full range of possible errors, and the best model achieves an F1 score of 0.67. |
A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing work on pre-trained generative models often fails to detect non-existent or incorrect content . Existing studies have attempted to detect hallucinations based on oracle references . |
| Approach: | They propose a token-level, reference-free hallucination detection task based on Wikipedia annotations to detect non-existent or incorrect content. |
| Outcome: | The proposed task is token-level, reference-free hallucination detection task and dataset . authors argue that the proposed task can be used in real-time to detect hallucines . |
SAFE: A Sparse Autoencoder-Based Framework for Robust Query Enrichment and Hallucination Mitigation in LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models suffer from hallucinations, which can undermine their performance in critical applications. |
| Approach: | They propose a framework for detecting and mitigating hallucinations by leveraging SAEs. |
| Outcome: | The proposed framework improves query generation accuracy and mitigates hallucinations across datasets. |