Challenge: Large language models (LLMs) have been shown to possess impressive capabilities, but they are not problem-free.
Approach: They explore the behavior of large language models when presented with (un)answerable queries.
Outcome: The proposed models encode the answerability of an input query, the authors show . they also show that the first decoded token is a strong indicator .

Similar Papers

On Large Language Models’ Hallucination with Regard to Known Facts (2024.naacl-long)

Copied to clipboard

Challenge: Large language models are successful in answering factoid questions but are also prone to hallucination.
Approach: They propose self-reporting to the model when faced with such limitations.
Outcome: The proposed classifier can detect hallucinations with an 88% success rate and can be used to answer factoid questions with correct answer knowledge.
What Makes a Good Query? Measuring the Impact of Human-Confusing Linguistic Features on LLM Performance (2026.findings-eacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are often treated as defects of the model or its decoding strategy.
Approach: They construct a 22-dimension query feature vector covering clause complexity, lexical rarity, anaphora, negation, answerability, and intention grounding.
Outcome: The proposed model covers clause complexity, lexical rarity, anaphora, negation, answerability, and intention grounding, all known to affect human comprehension.
The Impact of Negated Text on Hallucination with Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies on hallucination in large language models (LLMs) have been actively progressing in natural language processing.
Approach: They propose to examine whether LLMs can recognize contextual shifts caused by negation and still reliably distinguish hallucinations comparable to affirmative cases.
Outcome: The proposed model can detect hallucinations comparable to affirmative cases, but it is difficult to detect them in negated text, the authors show .
Are the Hidden States Hiding Something? Testing the Limits of Factuality-Encoding Capabilities in LLMs (2025.acl-long)

Copied to clipboard

Challenge: Recent studies suggest that LLMs encode internal representations of factuality when generating inaccurate or fabricated content.
Approach: They propose a strategy for sampling plausible true-false factoid sentences from tabular data and a procedure for generating realistic, LLM-dependent true-False datasets from Question Answering collections.
Outcome: The proposed approach lays the groundwork for future research on factuality in LLMs and offers practical guidelines for more effective evaluation.
Detecting LLM Hallucination Through Layer-wise Information Deficiency: Analysis of Ambiguous Prompts and Unanswerable Questions (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) often generate confident yet inaccurate responses, introducing significant risks for deployment in safety-critical domains.
Approach: They propose a method to detect model hallucination by systematic analysis of information flow across model layers.
Outcome: The proposed approach improves model reliability by immediately integrating with universal LLMs without additional training or architectural modifications.
InterrogateLLM: Zero-Resource Hallucination Detection in LLM-Generated Answers (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for detecting hallucinations in large language models are limited due to their high frequency and high accuracy.
Approach: They propose a method to detect hallucinations in large language models by repeating model-generated responses from its generated answer.
Outcome: The proposed method achieves 87% hallucinations in a specific experiment without external knowledge.
Do Robot Snakes Dream like Electric Sheep? Investigating the Effects of Architectural Inductive Biases on Hallucination (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have a tendency to hallucinate false or misleading information, limiting their reliability.
Approach: They examine how architecture-based inductive biases affect the propensity to hallucinate . they find that the models are more reliable and more reliable than traditional models .
Outcome: The proposed models can be used to train and train large language models that are factual or able to explain themselves through their knowledge.
Tutorial Proposal: Hallucination in Large Language Models (2024.lrec-tutorials)

Copied to clipboard

Challenge: Grasping the intricacies of hallucination in LLMs can be daunting, especially for those new to the field.
Approach: This tutorial aims to bridge the gap between the field and the field of hallucination . it will explore the key aspects of hallucinonation, including benchmarking, detection, and mitigation techniques .
Outcome: This tutorial will explore the key aspects of hallucination in LLMs . it will also explore the specific constraints and shortcomings of current approaches .
Why LLMs Hallucinate on Structured Knowledge: A Mechanistic Analysis of Reasoning over Linearized Representations (2026.acl-long)

Copied to clipboard

Challenge: Existing literature primarily addresses this problem through external interventions such as retrieval augmentation and prompt engineering at the input or output level.
Approach: They find that LLMs can still produce hallucinated outputs when using structured external knowledge.
Outcome: The proposed models fail to ground the provided knowledge, causing the model to revert to parametric memory.
Beyond Facts: Evaluating Intent Hallucination in Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) produce unsatisfactory results when faced with complex queries containing multiple conditions.
Approach: They propose a benchmark for intent hallucination that covers 20,068 problems and an automatic LLM generation evaluation metric for detecting intent hallucinosis.
Outcome: The proposed benchmark covers query-only and retrieval-augmented generation (RAG) setups with varying topics and difficulty.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations