Challenge: a growing number of researchers are studying the hallucination issue in large language models.
Approach: They propose a hallucination detection benchmark and a method to detect hallucines in LLMs.
Outcome: The proposed method detects hallucinations and mitigates them using different training stages.

Similar Papers

The Troubling Emergence of Hallucination in Large Language Models - An Extensive Definition, Quantification, and Prescriptive Remediations (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models have generated widespread acclaim, but hallucination has also emerged as a by-product.
Approach: They propose a fine-grained discourse on profiling hallucination based on its degree, orientation, and category . they categorize hallucines into six types: acronym ambiguity, generated golem, virtual voice, geographic erratum, time wrap .
Outcome: The proposed method categorizes hallucination into six types based on their degree, orientation, and category .
Tutorial Proposal: Hallucination in Large Language Models (2024.lrec-tutorials)

Copied to clipboard

Challenge: Grasping the intricacies of hallucination in LLMs can be daunting, especially for those new to the field.
Approach: This tutorial aims to bridge the gap between the field and the field of hallucination . it will explore the key aspects of hallucinonation, including benchmarking, detection, and mitigation techniques .
Outcome: This tutorial will explore the key aspects of hallucination in LLMs . it will also explore the specific constraints and shortcomings of current approaches .
Halwasa: Quantify and Analyze Hallucinations in Large Language Models: Arabic as a Case Study (2024.lrec-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) generate text that is factually incorrect, nonsensical, or misleading.
Approach: They create a large Arabic dataset that contains 10K of LLM generated sentences and annotate it for factuality and correctness.
Outcome: The proposed dataset analyzes 10K of generated sentences and finds 25% of them are factually incorrect.
HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Existing large language models (LLMs) are prone to generate hallucinations . a recent study shows that LLMs are able to generate content that conflicts with the source or cannot be verified by factual knowledge.
Approach: They propose a framework to evaluate the performance of large language models (LLMs) they propose to use a sample of generated and human-annotated hallucinated samples to evaluate their performance .
Outcome: The proposed framework generates and annotates hallucinated samples from ChatGPT . the results show that existing LLMs face great challenges in recognizing hallucines .
On Large Language Models’ Hallucination with Regard to Known Facts (2024.naacl-long)

Copied to clipboard

Challenge: Large language models are successful in answering factoid questions but are also prone to hallucination.
Approach: They propose self-reporting to the model when faced with such limitations.
Outcome: The proposed classifier can detect hallucinations with an 88% success rate and can be used to answer factoid questions with correct answer knowledge.
HALoGEN: Fantastic LLM Hallucinations and Where to Find Them (2025.acl-long)

Copied to clipboard

Challenge: generative large language models produce hallucinations that are not aligned with world knowledge or input context.
Approach: They propose a hallucination benchmark framework that measures hallucinism in large language models . they evaluate 150,000 generations from 14 language models and find they are riddled with hallucinos .
Outcome: The proposed framework evaluates 150,000 generations from 14 language models.
InterrogateLLM: Zero-Resource Hallucination Detection in LLM-Generated Answers (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for detecting hallucinations in large language models are limited due to their high frequency and high accuracy.
Approach: They propose a method to detect hallucinations in large language models by repeating model-generated responses from its generated answer.
Outcome: The proposed method achieves 87% hallucinations in a specific experiment without external knowledge.
Language Models Hallucinate, but May Excel at Fact Verification (2024.naacl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have produced non-factual outputs . however, current LLMs suffer from the hallucination issue .
Approach: They propose to use instruction-tuned LLMs to generate factual outputs . they find that FLAN-T5-11B performs best as a fact verifier .
Outcome: The proposed method outperforms more capable LLMs like GPT3.5 and ChatGPT in the human evaluation.
Addressing Bias and Hallucination in Large Language Models (2024.lrec-tutorials)

Copied to clipboard

Challenge: This tutorial provides a comprehensive overview of two critical aspects of Large Language Models: bias and hallucination.
Approach: This tutorial provides an overview of two critical aspects of Large Language Models: bias and hallucination.
Outcome: This tutorial delves into the complex dimensions of Large Language Models (LLMs) it outlines ethical considerations pertinent to their development and discusses hallucination, a prevalent issue in generative AI systems such as LLMs.
The Illusion of Progress: Re-evaluating Hallucination Detection in LLMs (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have revolutionized natural language processing, but their tendency to hallucinate poses serious challenges for reliable deployment.
Approach: They propose to use ROUGE to assess lexical overlap to determine accuracy of hallucination detection methods.
Outcome: The proposed evaluation frameworks can rival complex methods, exposing a fundamental flaw in current evaluation practices.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations