| Challenge: | Existing efforts to alleviate hallucination in chatbots require additional training and data annotation. |
| Approach: | They propose a Citation-Enhanced Generation approach that uses retrieval argumentation to generate citations and a natural language inference-based citation generation module to generate content. |
| Outcome: | The proposed method outperforms state-of-the-art methods on three benchmarks. |
Similar Papers
ReEval: Automatic Hallucination Evaluation for Retrieval-Augmented Large Language Models via Transferable Adversarial Attacks (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing static benchmarks do not guarantee that models can use the provided evidence for answering, which is essential to avoid hallucination when the required knowledge is new or private. |
| Approach: | They propose to automatically perturb existing static one for dynamic evaluation by using a chatGPT framework and a set of open-domain QA datasets. |
| Outcome: | The proposed framework generates new test cases on two open-domain QA datasets and is human-readable and useful to trigger hallucination in LLMs. |
Enhancing Hallucination Detection through Perturbation-Based Synthetic Data Generation in System Responses (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for hallucination detection are expensive and outdated . despite the popularity of LLMs, the issue of hallucinosity poses significant concerns for downstream users. |
| Approach: | They propose an approach that automatically generates both faithful and hallucinated outputs by rewriting system responses. |
| Outcome: | The proposed model outperforms state-of-the-art zero-shot detectors and existing synthetic generation methods in accuracy and latency. |
Detecting Hallucination and Coverage Errors in Retrieval Augmented Generation for Controversial Topics (2024.lrec-main)
Copied to clipboard
Tyler A. Chang, Katrin Tomanek, Jessica Hoffmann, Nithum Thain, Erin MacMurray van Liemt, Kathleen Meier-Hellstern, Lucas Dixon
| Challenge: | a growing audience of users is engaging with LLM-driven chatbots. |
| Approach: | They propose a strategy to handle controversial topics in LLM-based chatbots based on Wikipedia’s Neutral Point of View principle. |
| Outcome: | The proposed methods detect errors in the tuned LLM responses even when no training data is available. |
Ask, Assess, and Refine: Rectifying Factual Consistency and Hallucination in LLMs with Metric-Guided Feedback Learning (2024.eacl-long)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have heralded unprecedented capabilities in information seeking and text generation, but challenges remain regarding citation errors and generating information not present in the evidence (hallucination). |
| Approach: | They propose a framework to assess citation errors and hallucination using an explicit evaluation paradigm to formulate actionable natural language feedback. |
| Outcome: | The proposed approach improves correctness, fluency, and citation quality and reduces hallucinations in the results. |
RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Retrieval-augmented generation (RAG) is a main technique for alleviating hallucinations in large language models. |
| Approach: | They propose to integrate RAG into large language models to analyze word-level hallucinations using a corpus of 18,000 naturally generated responses from diverse LLMs. |
| Outcome: | The proposed model can fine tune a relatively small LLM and achieve a competitive hallucination detection performance when compared to the existing prompt-based approaches. |
HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) are prone to generate hallucinations . a recent study shows that LLMs are able to generate content that conflicts with the source or cannot be verified by factual knowledge. |
| Approach: | They propose a framework to evaluate the performance of large language models (LLMs) they propose to use a sample of generated and human-annotated hallucinated samples to evaluate their performance . |
| Outcome: | The proposed framework generates and annotates hallucinated samples from ChatGPT . the results show that existing LLMs face great challenges in recognizing hallucines . |
LLM Agents Implement an NLG System from Scratch: Building Interpretable Rule-Based RDF-to-Text Generators (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Existing neural approaches to generate RDF-to-text are limited in their implementation. |
| Approach: | They propose a framework where the model is “trained” through collaborative interactions among multiple LLM agents rather than traditional backpropagation. |
| Outcome: | The proposed framework reduces hallucinations and fluency penalties on the WebNLG and OpenDialKG datasets. |
Reducing Hallucinations in Language Model-based SPARQL Query Generation Using Post-Generation Memory Retrieval (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are susceptible to hallucinations and out-of-distribution errors when generating KG elements, such as Uniform Resource Identifiers (URIs). |
| Approach: | They propose a SPARQL query-generating framework that uses natural language placeholders and a non-parametric memory module to retrieve and resolve the correct KG URIs. |
| Outcome: | The proposed framework significantly enhances query correctness across various LLMs, datasets, and distribution shifts while achieving the near-complete suppression of URI hallucinations. |
ANAH: Analytical Annotation of Hallucinations in Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | a comprehensive and fine-grained measurement of the hallucination is crucial for LLMs' wide applications. |
| Approach: | They propose a dataset that offers ANalytical Annotation of Hallucinations in Large Language Models. |
| Outcome: | The proposed dataset can be used to train and evaluate hallucination annotators. |
HALoGEN: Fantastic LLM Hallucinations and Where to Find Them (2025.acl-long)
Copied to clipboard
| Challenge: | generative large language models produce hallucinations that are not aligned with world knowledge or input context. |
| Approach: | They propose a hallucination benchmark framework that measures hallucinism in large language models . they evaluate 150,000 generations from 14 language models and find they are riddled with hallucinos . |
| Outcome: | The proposed framework evaluates 150,000 generations from 14 language models. |