Language Models Hallucinate, but May Excel at Fact Verification (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have produced non-factual outputs . however, current LLMs suffer from the hallucination issue . |
| Approach: | They propose to use instruction-tuned LLMs to generate factual outputs . they find that FLAN-T5-11B performs best as a fact verifier . |
| Outcome: | The proposed method outperforms more capable LLMs like GPT3.5 and ChatGPT in the human evaluation. |
Similar Papers
On Large Language Models’ Hallucination with Regard to Known Facts (2024.naacl-long)
Copied to clipboard
Che Jiang, Biqing Qi, Xiangyu Hong, Dayuan Fu, Yang Cheng, Fandong Meng, Mo Yu, Bowen Zhou, Jie Zhou
| Challenge: | Large language models are successful in answering factoid questions but are also prone to hallucination. |
| Approach: | They propose self-reporting to the model when faced with such limitations. |
| Outcome: | The proposed classifier can detect hallucinations with an 88% success rate and can be used to answer factoid questions with correct answer knowledge. |
HALoGEN: Fantastic LLM Hallucinations and Where to Find Them (2025.acl-long)
Copied to clipboard
| Challenge: | generative large language models produce hallucinations that are not aligned with world knowledge or input context. |
| Approach: | They propose a hallucination benchmark framework that measures hallucinism in large language models . they evaluate 150,000 generations from 14 language models and find they are riddled with hallucinos . |
| Outcome: | The proposed framework evaluates 150,000 generations from 14 language models. |
Sources of Hallucination by Large Language Models on Inference Tasks (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are claimed to be capable of Natural Language Inference (NLI) |
| Approach: | They propose to use LLMs to probe their behavior using controlled experiments. |
| Outcome: | The proposed models perform significantly worse on NLI test samples which do not conform to these biases than those which do. |
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | a growing number of researchers are studying the hallucination issue in large language models. |
| Approach: | They propose a hallucination detection benchmark and a method to detect hallucines in LLMs. |
| Outcome: | The proposed method detects hallucinations and mitigates them using different training stages. |
Fact-Checking the Output of Large Language Models via Token-Level Uncertainty Quantification (2024.findings-acl)
Copied to clipboard
Ekaterina Fadeeva, Aleksandr Rubashevskii, Artem Shelmanov, Sergey Petrakov, Haonan Li, Hamdy Mubarak, Evgenii Tsymbalov, Gleb Kuzmin, Alexander Panchenko, Timothy Baldwin, Preslav Nakov, Maxim Panov
| Challenge: | Large language models are notorious for producing erroneous claims in their output. |
| Approach: | They propose a fact-checking and hallucination detection pipeline based on token-level uncertainty quantification that removes the impact of uncertainty about what claim to generate on the current step and what surface form to use. |
| Outcome: | The proposed method can fact-check the atomic claims in the output of large language models. |
Are the Hidden States Hiding Something? Testing the Limits of Factuality-Encoding Capabilities in LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies suggest that LLMs encode internal representations of factuality when generating inaccurate or fabricated content. |
| Approach: | They propose a strategy for sampling plausible true-false factoid sentences from tabular data and a procedure for generating realistic, LLM-dependent true-False datasets from Question Answering collections. |
| Outcome: | The proposed approach lays the groundwork for future research on factuality in LLMs and offers practical guidelines for more effective evaluation. |
Simple Factuality Probes Detect Hallucinations in Long-Form Natural Language Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to detect hallucination require many samples from the LLM generator . current methods require multiple samples, which is computationally infeasible . |
| Approach: | They propose a simple baseline for detecting hallucinations in long-form LLM generations . they show that LLM hidden states are highly predictive of factuality in long form natural language generation . |
| Outcome: | The proposed method is comparable to expensive multi-sample approaches while drawing only a single sample from the LLM generator. |
Chain-of-Verification Reduces Hallucination in Large Language Models (2024.findings-acl)
Copied to clipboard
Shehzaad Dhuliawala, Mojtaba Komeili, Jing Xu, Roberta Raileanu, Xian Li, Asli Celikyilmaz, Jason Weston
| Challenge: | Large language models can generate plausible but incorrect factual information, termed hallucinations, but they can still fail on lesser known facts. |
| Approach: | They develop a method that allows language models to deliberate on the responses they give in order to correct their errors. |
| Outcome: | The proposed method decreases hallucinations across a variety of tasks, including list-based questions, closed book MultiSpanQA and longform text generation. |
On the Universal Truthfulness Hyperplane Inside LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have explored hallucinations through the lens of internal representations, proposing mechanisms to decipher LLMs’ adherence to facts. |
| Approach: | They propose to train a universal truthfulness hyperplane that distinguishes the model’s factually correct and incorrect outputs on a diverse collection of over 40 datasets and examine its cross-task, cross-domain, and in-domain generalization. |
| Outcome: | The proposed model is able to distinguish factual outputs from incorrect outputs on a diverse collection of over 40 datasets. |
Halwasa: Quantify and Analyze Hallucinations in Large Language Models: Arabic as a Case Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) generate text that is factually incorrect, nonsensical, or misleading. |
| Approach: | They create a large Arabic dataset that contains 10K of LLM generated sentences and annotate it for factuality and correctness. |
| Outcome: | The proposed dataset analyzes 10K of generated sentences and finds 25% of them are factually incorrect. |