Monitoring Decoding: Mitigating Hallucination via Evaluating the Factuality of Partial Response during Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to mitiga hallucinations rely on sampling multiple full-length generations, which introduces significant response latency and becomes ineffective when the model consistently produces hallucines. |
| Approach: | They propose a framework that dynamically monitors the generation process and selectively applies in-process interventions to revise hallucination-prone tokens. |
| Outcome: | The proposed framework outperforms self-consistency-based approaches in both effectiveness and efficiency, achieving higher factual accuracy while significantly reducing computational overhead. |
Similar Papers
Active Layer-Contrastive Decoding Reduces Hallucination in Large Language Model Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent decoding methods improve the factuality of large language models (LLMs) by refining how the next token is selected during generation. |
| Approach: | They propose a decoding strategy that actively decides when to apply contrasting layers during generation by casting decoding as a sequential decision-making problem. |
| Outcome: | The proposed method surpasses state-of-the-art methods across five benchmarks and mitigates hallucinations in diverse generation scenarios. |
Enhancing Hallucination Detection through Perturbation-Based Synthetic Data Generation in System Responses (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for hallucination detection are expensive and outdated . despite the popularity of LLMs, the issue of hallucinosity poses significant concerns for downstream users. |
| Approach: | They propose an approach that automatically generates both faithful and hallucinated outputs by rewriting system responses. |
| Outcome: | The proposed model outperforms state-of-the-art zero-shot detectors and existing synthetic generation methods in accuracy and latency. |
Alleviating Hallucinations of Large Language Models through Induced Hallucinations (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies have shown that large language models generate inaccurate or fabricated information, a phenomenon known as hallucinations. |
| Approach: | They propose a simple strategy to induce-then-contrast decode LLMs to enhance their factuality . they first induce hallucinations from the original model and penalize them . |
| Outcome: | The proposed strategy improves factuality of large language models across task formats, model sizes, and model families. |
HALoGEN: Fantastic LLM Hallucinations and Where to Find Them (2025.acl-long)
Copied to clipboard
| Challenge: | generative large language models produce hallucinations that are not aligned with world knowledge or input context. |
| Approach: | They propose a hallucination benchmark framework that measures hallucinism in large language models . they evaluate 150,000 generations from 14 language models and find they are riddled with hallucinos . |
| Outcome: | The proposed framework evaluates 150,000 generations from 14 language models. |
Detecting Hallucinated Content in Conditional Neural Sequence Generation (2021.findings-acl)
Copied to clipboard
Chunting Zhou, Graham Neubig, Jiatao Gu, Mona Diab, Francisco Guzmán, Luke Zettlemoyer, Marjan Ghazvininejad
| Challenge: | Neural sequence models can generate fluent sentences, but they can also hallucinate additional content not supported by the input. |
| Approach: | They propose a task to predict whether each token in the output sequence is hallucinated and collect manually annotated evaluation sets for this task. |
| Outcome: | The proposed method outperforms baseline methods on machine translation and abstractive summarization datasets and achieves significant improvements in both supervised and unsupervised settings. |
Critic-Driven Decoding for Mitigating Hallucinations in Data-to-text Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Hallucination of text lacking grounding in input data is a problem in neural data-to-text generation. |
| Approach: | They propose to combine probabilistic output of a generator language model with the output of an “text critic” classifier which guides the generation by assessing the match between the input data and the generated text. |
| Outcome: | The proposed method improves on the WebNLG and OpenDialKG benchmarks. |
Developing a Reliable, Fast, General-Purpose Hallucination Detection and Mitigation Service (2025.naacl-industry)
Copied to clipboard
| Challenge: | Hallucination is a problem in large language models that produce incorrect output . authors propose a reliable and high-speed production system to detect and rectify hallucinations . |
| Approach: | They propose a high-speed production system that detects hallucinations in LLMs . they propose NER, natural language inference, span-based detection and a rewriting mechanism . |
| Outcome: | The proposed system detects a wide range of hallucinations in LLM responses. |
Hallucination Detection for Generative Large Language Models by Bayesian Sequential Estimation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for detecting hallucinations require large numbers of observations to be retrieved, increasing response times. |
| Approach: | They propose a framework that leverages Bayesian sequential analysis to optimize the trade-off between costs and benefits during the hallucination detection process. |
| Outcome: | The proposed framework surpasses existing methods in efficiency and precision of hallucination detection. |
Rethinking Hallucinations: Correctness, Consistency, and Prompt Multiplicity (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing hallucination evaluations focus only on correctness and often overlook consistency . a significant inconsistency in benchmarks like Med-HALT suggests hallucianation-related harms have been misunderstood. |
| Approach: | They propose a framework for quantifying consistency in hallucination evaluations . they find that detection techniques detect consistency, not correctness . |
| Outcome: | The proposed framework uncovers critical limitations in hallucination evaluations. |
Mixture of Decoding: An Attention-Inspired Adaptive Decoding Strategy to Mitigate Hallucinations in Large Vision-Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) have impressive capabilities across visual tasks, yet they remain hindered by the persistent challenge of hallucinations. |
| Approach: | They propose a novel approach that dynamically adapts decoding strategies by evaluating the correctness of the model’s attention on image tokens to distinguish the correct attention. |
| Outcome: | Extensive experiments show that the proposed approach outperforms existing decoding methods across multiple mainstream benchmarks, effectively mitigating hallucinations in LVLMs. |