Challenge: a long line of work suggests that LLMs face issues along both dimensions .
Approach: They investigate hallucination detectors' failure modes and their effects on the task accuracy of four LLMs and three halluciner detectors.
Outcome: The models show impressive performance in high-resource languages like English but the performance degrades significantly in low-resourced languages like Bengali.

Similar Papers

How Much Do LLMs Hallucinate across Languages? On Realistic Multilingual Estimation of LLM Hallucination (2025.emnlp-main)

Copied to clipboard

Challenge: despite LLMs becoming increasingly multilingual, most studies on detecting and quantifying LLM hallucination are English-centric .
Approach: They train a multilingual hallucination detection model and conduct a large-scale study across 30 languages and 6 open-source LLM families.
Outcome: The proposed model is based on an English-centric model and annotates gold data for five high-resource languages.
The Illusion of Progress: Re-evaluating Hallucination Detection in LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have revolutionized natural language processing, but their tendency to hallucinate poses serious challenges for reliable deployment.
Approach: They propose to use ROUGE to assess lexical overlap to determine accuracy of hallucination detection methods.
Outcome: The proposed evaluation frameworks can rival complex methods, exposing a fundamental flaw in current evaluation practices.
InterrogateLLM: Zero-Resource Hallucination Detection in LLM-Generated Answers (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for detecting hallucinations in large language models are limited due to their high frequency and high accuracy.
Approach: They propose a method to detect hallucinations in large language models by repeating model-generated responses from its generated answer.
Outcome: The proposed method achieves 87% hallucinations in a specific experiment without external knowledge.
The Impact of Negated Text on Hallucination with Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies on hallucination in large language models (LLMs) have been actively progressing in natural language processing.
Approach: They propose to examine whether LLMs can recognize contextual shifts caused by negation and still reliably distinguish hallucinations comparable to affirmative cases.
Outcome: The proposed model can detect hallucinations comparable to affirmative cases, but it is difficult to detect them in negated text, the authors show .
Detecting LLM Hallucination Through Layer-wise Information Deficiency: Analysis of Ambiguous Prompts and Unanswerable Questions (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) often generate confident yet inaccurate responses, introducing significant risks for deployment in safety-critical domains.
Approach: They propose a method to detect model hallucination by systematic analysis of information flow across model layers.
Outcome: The proposed approach improves model reliability by immediately integrating with universal LLMs without additional training or architectural modifications.
Zero-Resource Hallucination Prevention for Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for detecting hallucinations post-generation suffer from inconsistent performance due to the influence of instruction format and model style.
Approach: They propose a new technique that evaluates the model’s familiarity with the concepts present in the input instruction and withholding the generation of response in case of unfamiliar concepts under the zero-resource setting.
Outcome: The proposed technique shows superior performance across four different large language models and demonstrates that it can be used to mitigate hallucinations in LLMs.
Why LLMs Hallucinate on Structured Knowledge: A Mechanistic Analysis of Reasoning over Linearized Representations (2026.acl-long)

Copied to clipboard

Challenge: Existing literature primarily addresses this problem through external interventions such as retrieval augmentation and prompt engineering at the input or output level.
Approach: They find that LLMs can still produce hallucinated outputs when using structured external knowledge.
Outcome: The proposed models fail to ground the provided knowledge, causing the model to revert to parametric memory.
Machine Translation Hallucination Detection for Low and High Resource Languages using Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for detecting hallucinations in machine translation are limited for low-resource languages.
Approach: They evaluate sentence-level hallucination detection approaches using Large Language Models (LLMs) they find that the choice of model is essential for performance.
Outcome: The proposed models outperform the existing models in HRLs and LRLs on average by 0.16 MCC.
Do Robot Snakes Dream like Electric Sheep? Investigating the Effects of Architectural Inductive Biases on Hallucination (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have a tendency to hallucinate false or misleading information, limiting their reliability.
Approach: They examine how architecture-based inductive biases affect the propensity to hallucinate . they find that the models are more reliable and more reliable than traditional models .
Outcome: The proposed models can be used to train and train large language models that are factual or able to explain themselves through their knowledge.
Sources of Hallucination by Large Language Models on Inference Tasks (2023.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) are claimed to be capable of Natural Language Inference (NLI)
Approach: They propose to use LLMs to probe their behavior using controlled experiments.
Outcome: The proposed models perform significantly worse on NLI test samples which do not conform to these biases than those which do.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations