| Challenge: | Despite advances in large language models, hallucination remains a critical failure mode . despite these advances, LLMs are prone to hallucinic outputs that contain illusory information presented as if it were factual or grounded in reality. |
| Approach: | They propose to isolate and analyze confabulation, a foundational aspect of hallucination, where the model fabricates facts about unknown entities. |
| Outcome: | The proposed method reveals that the model can fabricate facts with minimal disruption, shedding light on the inner representations that drive factual and non-factual output. |
Similar Papers
Confabulation: The Surprising Value of Large Language Model Hallucinations (2024.acl-long)
Copied to clipboard
| Challenge: | 'confabulations' are inherently problematic and AI research should eliminate this flaw, but confabulation is not a problem. |
| Approach: | They argue that measurable semantic characteristics of large language model (LLM) hallucinations mirror a human propensity to utilize increased narrativity as a cognitive resource for sense-making and communication. |
| Outcome: | The proposed study shows that measurable semantic characteristics of LLM confabulations mirror human propensity to utilize increased narrativity as a cognitive resource for sense-making and communication. |
The Troubling Emergence of Hallucination in Large Language Models - An Extensive Definition, Quantification, and Prescriptive Remediations (2023.emnlp-main)
Copied to clipboard
Vipula Rawte, Swagata Chakraborty, Agnibh Pathak, Anubhav Sarkar, S.M Towhidul Islam Tonmoy, Aman Chadha, Amit Sheth, Amitava Das
| Challenge: | Recent advances in Large Language Models have generated widespread acclaim, but hallucination has also emerged as a by-product. |
| Approach: | They propose a fine-grained discourse on profiling hallucination based on its degree, orientation, and category . they categorize hallucines into six types: acronym ambiguity, generated golem, virtual voice, geographic erratum, time wrap . |
| Outcome: | The proposed method categorizes hallucination into six types based on their degree, orientation, and category . |
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | a growing number of researchers are studying the hallucination issue in large language models. |
| Approach: | They propose a hallucination detection benchmark and a method to detect hallucines in LLMs. |
| Outcome: | The proposed method detects hallucinations and mitigates them using different training stages. |
Tutorial Proposal: Hallucination in Large Language Models (2024.lrec-tutorials)
Copied to clipboard
| Challenge: | Grasping the intricacies of hallucination in LLMs can be daunting, especially for those new to the field. |
| Approach: | This tutorial aims to bridge the gap between the field and the field of hallucination . it will explore the key aspects of hallucinonation, including benchmarking, detection, and mitigation techniques . |
| Outcome: | This tutorial will explore the key aspects of hallucination in LLMs . it will also explore the specific constraints and shortcomings of current approaches . |
Detecting LLM Hallucination Through Layer-wise Information Deficiency: Analysis of Ambiguous Prompts and Unanswerable Questions (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) often generate confident yet inaccurate responses, introducing significant risks for deployment in safety-critical domains. |
| Approach: | They propose a method to detect model hallucination by systematic analysis of information flow across model layers. |
| Outcome: | The proposed approach improves model reliability by immediately integrating with universal LLMs without additional training or architectural modifications. |
LAFaCT: Attribution-based Localization and Focused Sequential Analysis of Fact-Critical Tokens for Hallucination Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models suffer from hallucinations, severely undermining their reliability. |
| Approach: | They propose a framework that localizes fact-critical tokens and performs sequential analysis on their hidden states. |
| Outcome: | The proposed framework localizes fact-critical tokens using Factual Criticality . it then performs a focused sequential analysis on their hidden states . |
HALoGEN: Fantastic LLM Hallucinations and Where to Find Them (2025.acl-long)
Copied to clipboard
| Challenge: | generative large language models produce hallucinations that are not aligned with world knowledge or input context. |
| Approach: | They propose a hallucination benchmark framework that measures hallucinism in large language models . they evaluate 150,000 generations from 14 language models and find they are riddled with hallucinos . |
| Outcome: | The proposed framework evaluates 150,000 generations from 14 language models. |
CausalGaze: Unveiling Hallucinations via Counterfactual Graph Intervention in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing classification-based methods capture noise and spurious correlations while overlooking the underlying causal mechanisms. |
| Approach: | They propose a hallucination detection framework based on structural causal models that captures static and passive signals from internal states and employs counterfactual interventions to disentangle causal reasoning paths from incidental noise. |
| Outcome: | Experiments on four datasets and three widely used LLMs show that the proposed framework improves AUROC and interpretability. |
Fine-Grained Detection of Context-Grounded Hallucinations Using LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing representations of hallucinations limit the types of errors that can be expressed, so we propose a new representation based on free-form textual descriptions, capturing the full range of possible errors. |
| Approach: | They propose a benchmark for localizing hallucinations using LLMs with a human annotation of over 1,000 examples and a protocol to verify its quality in a humans evaluation. |
| Outcome: | The proposed representation captures the full range of possible errors, and the best model achieves an F1 score of 0.67. |
Simple Factuality Probes Detect Hallucinations in Long-Form Natural Language Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to detect hallucination require many samples from the LLM generator . current methods require multiple samples, which is computationally infeasible . |
| Approach: | They propose a simple baseline for detecting hallucinations in long-form LLM generations . they show that LLM hidden states are highly predictive of factuality in long form natural language generation . |
| Outcome: | The proposed method is comparable to expensive multi-sample approaches while drawing only a single sample from the LLM generator. |