Mingda Chen, Yang Li, Karthik Padthe, Rulin Shao, Alicia Yi Sun, Luke Zettlemoyer, Gargi Ghosh, Wen-tau Yih
| Challenge: | Large language models can generate factually inaccurate content, a problem known as hallucination. |
| Approach: | They propose an approach that integrates a working memory that receives feedback from external resources. |
| Outcome: | The proposed method outperforms baselines on four fact-seeking datasets and increases the factuality metric by 2 to 6 points absolute. |
Similar Papers
RAC: Efficient LLM Factuality Correction with Retrieval Augmentation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit impressive results across a wide range of tasks, yet they can often produce factually incorrect outputs. |
| Approach: | They propose a low-latency post-correction method that decomposes the LLM’s output into atomic facts and applies a fine-grained verification and correction process with retrieved content to verify and correct the Llm-generated output. |
| Outcome: | The proposed method has greatly reduced latency and token consumption up to 7x compared to previous state-of-the-art methods with similar or better performance. |
VeriFact: Enhancing Long-Form Factuality Evaluation with Refined Fact Extraction and Reference Facts (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prior work focuses on accuracy and precision, but factuality evaluation is difficult due to inter-sentence dependencies. |
| Approach: | They introduce a factuality evaluation framework to enhance fact extraction . they also introduce 'factRBench' that evaluates both precision and recall . |
| Outcome: | The proposed framework enhances fact extraction by identifying incomplete and missing facts . it also evaluates precision and recall in long-form models, whereas prior work focuses on precision. |
FactReasoner: A Probabilistic Approach to Long-Form Factuality Assessment for Large Language Models (2025.findings-emnlp)
Copied to clipboard
Radu Marinescu, Debarun Bhattacharjya, Junkyu Lee, Tigran T. Tchrakian, Javier Carnerero-Cano, Yufang Hou, Elizabeth M. Daly, Alessandra Pascale
| Challenge: | Large language models often fail to ensure factual accuracy of outputs thus limiting reliability in real-world applications. |
| Approach: | They propose a neuro-symbolic based factuality assessment framework that employs probabilistic reasoning to evaluate the truthfulness of long-form generated responses. |
| Outcome: | The proposed framework outperforms state-of-the-art prompt-based methods in factual accuracy and recall. |
Improving Model Factuality with Fine-grained Critique-based Evaluator (2025.acl-long)
Copied to clipboard
Yiqing Xie, Wenxuan Zhou, Pradyot Prakash, Di Jin, Yuning Mao, Quintin Fettes, Arya Talebzadeh, Sinong Wang, Han Fang, Carolyn Rose, Daniel Fried, Hejia Zhang
| Challenge: | Factuality evaluation aims to detect factual errors produced by language models and guide the development of more factual models. |
| Approach: | They propose a framework that leverages FenCE to improve the factuality of LM generators by constructing training data. |
| Outcome: | The proposed framework improves the factuality of LM generators by enhancing their training data. |
Teaching Language Models to Check Grounded Claim Factuality with Human Test-Taking Strategies (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for factuality checking require dataset-specific threshold tuning, while LLM-based approaches often use direct prompting. |
| Approach: | They propose to use a reading comprehension task to check for true/false claim factuality and prompt LLMs with explicit test-taking strategies for efficient reasoning. |
| Outcome: | The proposed method reduces token usage by over 80% compared to unguided open-ended reasoning and achieves competitive performance to more expensive alternatives. |
FactCorrector: A Graph-Inspired Approach to Long-Form Factuality Correction of Large Language Models (2026.acl-long)
Copied to clipboard
Javier Carnerero-Cano, Massimiliano Pronesti, Radu Marinescu, Tigran T. Tchrakian, James Barry, Jasmina Gajcin, Yufang Hou, Alessandra Pascale, Elizabeth M. Daly
| Challenge: | Large language models (LLMs) often produce factually incorrect responses. |
| Approach: | They propose a new method that adapts across domains without retraining and leverages structured feedback to generate a correction. |
| Outcome: | The proposed method outperforms baseline methods on a VELI5 dataset and several popular long-form factuality datasets. |
Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation (2025.naacl-long)
Copied to clipboard
Satyapriya Krishna, Kalpesh Krishna, Anhad Mohananey, Steven Schwarcz, Adam Stambler, Shyam Upadhyay, Manaal Faruqui
| Challenge: | Recent advances in Large Language Models (LLMs) have significantly enhanced their capabilities across various cognitive tasks. |
| Approach: | They propose a high-quality evaluation dataset to test LLMs' ability to provide factual responses, assess retrieval capabilities, and evaluate the reasoning required to generate final answers. |
| Outcome: | The proposed framework improves performance in end-to-end RAG scenarios. |
Provenance: A Light-weight Fact-checker for Retrieval Augmented LLM Generation Output (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods for fact checking RAG outputs rely on large language models. |
| Approach: | They propose a method that computes a factuality score that can be thresholded to yield a binary decision to check RAG outputs. |
| Outcome: | The proposed method is low latency and low cost at run-time and no need for LLM fine-tuning. |
Expanding before Inferring: Enhancing Factuality in Large Language Models through Premature Layers Interpolation (2025.emnlp-main)
Copied to clipboard
Dingwei Chen, Ziqiang Liu, Feiteng Fang, Chak Tou Leong, Shiwen Ni, Ahmadreza Argha, Hamid Alinejad-Rokny, Min Yang, Chengming Li
| Challenge: | Existing approaches to generating factually inconsistent outputs are resource-intensive. |
| Approach: | They propose a plug-and-play intervention designed to enhance factuality by inserting premature layers formed through mathematical interpolation with adjacent layers. |
| Outcome: | The proposed intervention reduces hallucinations while outperforming baselines on four datasets. |
Beyond Factual Accuracy: Evaluating Coverage of Diverse Factual Information in Long-form Text Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation frameworks for large language models focus on isolated aspects like * Equal contribution. |
| Approach: | They evaluate ICAT, an evaluation framework for measuring coverage of diverse factual information in long-form text generation. |
| Outcome: | The evaluation framework is based on three implementations with different assumptions on availability of aspects and alignment method. |