The Curious Case of Hallucinatory (Un)answerability: Finding Truths in the Hidden States of Over-Confident Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been shown to possess impressive capabilities, but they are not problem-free. |
| Approach: | They explore the behavior of large language models when presented with (un)answerable queries. |
| Outcome: | The proposed models encode the answerability of an input query, the authors show . they also show that the first decoded token is a strong indicator . |
Similar Papers
On Large Language Models’ Hallucination with Regard to Known Facts (2024.naacl-long)
Copied to clipboard
Che Jiang, Biqing Qi, Xiangyu Hong, Dayuan Fu, Yang Cheng, Fandong Meng, Mo Yu, Bowen Zhou, Jie Zhou
| Challenge: | Large language models are successful in answering factoid questions but are also prone to hallucination. |
| Approach: | They propose self-reporting to the model when faced with such limitations. |
| Outcome: | The proposed classifier can detect hallucinations with an 88% success rate and can be used to answer factoid questions with correct answer knowledge. |
What Makes a Good Query? Measuring the Impact of Human-Confusing Linguistic Features on LLM Performance (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are often treated as defects of the model or its decoding strategy. |
| Approach: | They construct a 22-dimension query feature vector covering clause complexity, lexical rarity, anaphora, negation, answerability, and intention grounding. |
| Outcome: | The proposed model covers clause complexity, lexical rarity, anaphora, negation, answerability, and intention grounding, all known to affect human comprehension. |
The Impact of Negated Text on Hallucination with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies on hallucination in large language models (LLMs) have been actively progressing in natural language processing. |
| Approach: | They propose to examine whether LLMs can recognize contextual shifts caused by negation and still reliably distinguish hallucinations comparable to affirmative cases. |
| Outcome: | The proposed model can detect hallucinations comparable to affirmative cases, but it is difficult to detect them in negated text, the authors show . |
Are the Hidden States Hiding Something? Testing the Limits of Factuality-Encoding Capabilities in LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies suggest that LLMs encode internal representations of factuality when generating inaccurate or fabricated content. |
| Approach: | They propose a strategy for sampling plausible true-false factoid sentences from tabular data and a procedure for generating realistic, LLM-dependent true-False datasets from Question Answering collections. |
| Outcome: | The proposed approach lays the groundwork for future research on factuality in LLMs and offers practical guidelines for more effective evaluation. |
Detecting LLM Hallucination Through Layer-wise Information Deficiency: Analysis of Ambiguous Prompts and Unanswerable Questions (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) often generate confident yet inaccurate responses, introducing significant risks for deployment in safety-critical domains. |
| Approach: | They propose a method to detect model hallucination by systematic analysis of information flow across model layers. |
| Outcome: | The proposed approach improves model reliability by immediately integrating with universal LLMs without additional training or architectural modifications. |
InterrogateLLM: Zero-Resource Hallucination Detection in LLM-Generated Answers (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for detecting hallucinations in large language models are limited due to their high frequency and high accuracy. |
| Approach: | They propose a method to detect hallucinations in large language models by repeating model-generated responses from its generated answer. |
| Outcome: | The proposed method achieves 87% hallucinations in a specific experiment without external knowledge. |
Do Robot Snakes Dream like Electric Sheep? Investigating the Effects of Architectural Inductive Biases on Hallucination (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have a tendency to hallucinate false or misleading information, limiting their reliability. |
| Approach: | They examine how architecture-based inductive biases affect the propensity to hallucinate . they find that the models are more reliable and more reliable than traditional models . |
| Outcome: | The proposed models can be used to train and train large language models that are factual or able to explain themselves through their knowledge. |
Tutorial Proposal: Hallucination in Large Language Models (2024.lrec-tutorials)
Copied to clipboard
| Challenge: | Grasping the intricacies of hallucination in LLMs can be daunting, especially for those new to the field. |
| Approach: | This tutorial aims to bridge the gap between the field and the field of hallucination . it will explore the key aspects of hallucinonation, including benchmarking, detection, and mitigation techniques . |
| Outcome: | This tutorial will explore the key aspects of hallucination in LLMs . it will also explore the specific constraints and shortcomings of current approaches . |
Why LLMs Hallucinate on Structured Knowledge: A Mechanistic Analysis of Reasoning over Linearized Representations (2026.acl-long)
Copied to clipboard
Shanghao Li, Jinda Han, Yibo Wang, Yuanjie Zhu, Zihe Song, Langzhou He, Kenan Kamel A Alghythee, Philip S. Yu
| Challenge: | Existing literature primarily addresses this problem through external interventions such as retrieval augmentation and prompt engineering at the input or output level. |
| Approach: | They find that LLMs can still produce hallucinated outputs when using structured external knowledge. |
| Outcome: | The proposed models fail to ground the provided knowledge, causing the model to revert to parametric memory. |
Beyond Facts: Evaluating Intent Hallucination in Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) produce unsatisfactory results when faced with complex queries containing multiple conditions. |
| Approach: | They propose a benchmark for intent hallucination that covers 20,068 problems and an automatic LLM generation evaluation metric for detecting intent hallucinosis. |
| Outcome: | The proposed benchmark covers query-only and retrieval-augmented generation (RAG) setups with varying topics and difficulty. |