Challenge: Existing studies on hallucination detection rely heavily on closed-source LLMs such as GPT-4.
Approach: They propose an LLM-based agent framework called HaluAgent that integrates LLMs, multi-functional toolbox and a memory mechanism for hallucination detection.
Outcome: The proposed framework integrates the LLM, multi-functional toolbox, and can detect hallucinations on Chinese and English datasets.

Similar Papers

HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Existing large language models (LLMs) are prone to generate hallucinations . a recent study shows that LLMs are able to generate content that conflicts with the source or cannot be verified by factual knowledge.
Approach: They propose a framework to evaluate the performance of large language models (LLMs) they propose to use a sample of generated and human-annotated hallucinated samples to evaluate their performance .
Outcome: The proposed framework generates and annotates hallucinated samples from ChatGPT . the results show that existing LLMs face great challenges in recognizing hallucines .
InterrogateLLM: Zero-Resource Hallucination Detection in LLM-Generated Answers (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for detecting hallucinations in large language models are limited due to their high frequency and high accuracy.
Approach: They propose a method to detect hallucinations in large language models by repeating model-generated responses from its generated answer.
Outcome: The proposed method achieves 87% hallucinations in a specific experiment without external knowledge.
Hallucination Detection in Long-Form Text Generated by LLMs: A Benchmark and a Hyper-Relational Knowledge Graph Approach (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for hallucination detection are coarse-grained and lack long-range consistency checks.
Approach: They propose a benchmark for long-form hallucination detection that incorporates diverse entity types and intricate factual dependencies spanning extended contexts.
Outcome: The proposed framework outperforms baselines and robustly integrates fact-centric hyper-relational knowledge graphs.
HalluDetect: Detecting, Mitigating, and Benchmarking Hallucinations in Conversational Systems in the Legal Domain (2025.emnlp-industry)

Copied to clipboard

Challenge: Large Language Models (LLMs) are widely used in industry but still produce hallucinations, limiting their reliability in critical applications.
Approach: They propose to reduce hallucinations in consumer grievance chatbots by reducing their token accuracy by 0.4159 per turn.
Outcome: The proposed system achieves an F1 score of 68.92% outperforming baseline detectors by 22.47% while maintaining the highest token accuracy.
How Much Do LLMs Hallucinate across Languages? On Realistic Multilingual Estimation of LLM Hallucination (2025.emnlp-main)

Copied to clipboard

Challenge: despite LLMs becoming increasingly multilingual, most studies on detecting and quantifying LLM hallucination are English-centric .
Approach: They train a multilingual hallucination detection model and conduct a large-scale study across 30 languages and 6 open-source LLM families.
Outcome: The proposed model is based on an English-centric model and annotates gold data for five high-resource languages.
HalluAudio: A Comprehensive Benchmark for Hallucination Detection in Large Audio-Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing studies on hallucination focus on text or vision, while few audio-oriented studies are limited in scale, modality coverage, and diagnostic depth.
Approach: They propose a large-scale benchmark for evaluating hallucinations across speech, sound, and music.
Outcome: The proposed model improves hallucination rate, yes/no bias, error-type analysis, and refusal rate.
Mitigating Hallucinated Translations in Large Language Models with Hallucination-focused Preference Optimization (2025.naacl-long)

Copied to clipboard

Challenge: Machine Translation (MT) systems based on fine-tuned large language models (LLMs) are at a higher risk of generating hallucinations, which can severely undermine user’s trust and safety.
Approach: They propose a method that intrinsically learns to mitigate hallucinations during the model training phase.
Outcome: The proposed method reduces hallucinations by 89% on an average across three unseen target languages while preserving translation quality.
When Models Lie, We Learn: Multilingual Span-Level Hallucination Detection with PsiloQA (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing hallucination detection benchmarks operate at the sequence level and are limited to English . Existing methods lacking fine-grained, multilingual supervision are limited in English based on the sequence .
Approach: They propose a large-scale, multilingual dataset annotated with span-level hallucinations across 14 languages.
Outcome: The proposed dataset annotated with span-level hallucinations across 14 languages is scalable and cost-efficient.
LLM Agents Implement an NLG System from Scratch: Building Interpretable Rule-Based RDF-to-Text Generators (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing neural approaches to generate RDF-to-text are limited in their implementation.
Approach: They propose a framework where the model is “trained” through collaborative interactions among multiple LLM agents rather than traditional backpropagation.
Outcome: The proposed framework reduces hallucinations and fluency penalties on the WebNLG and OpenDialKG datasets.
SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Existing fact-checking approaches require access to external databases or external databases . a lack of external databases can undermine trust in large language models.
Approach: They propose a sampling-based approach to fact-check black-box models without external databases.
Outcome: The proposed approach can be used to fact-check black-box models without external databases . it can detect non-factual and factual sentences and rank passages in terms of factuality .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations