Challenge: Large language models (LLMs) have raised hopes for automated end-to-end fact-checking, but prior studies report mixed results.
Approach: They evaluate 15 large language models on 6,000 claims fact-checked by PolitiFact . standard models perform poorly, reasoning offers minimal benefits, and web search provides only moderate gains .
Outcome: The models predict claim veracity and a curated RAG system improved macro F1 by 233% on average across model variants.

Similar Papers

Large Language Models Help Humans Verify Truthfulness – Except When They Are Convincingly Wrong (2024.naacl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly used for accessing information on the web.
Approach: They conduct experiments with 80 crowdworkers to compare LLMs with search engines . they ask LLM to provide contrastive information to reduce over-reliance on LLM .
Outcome: The results show that LLMs can outperform search engines but not LLM explanations . the study shows that LMS explanations are not reliable replacements for reading retrieved passages compared to search engines alone.
How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Study (2024.lrec-main)

Copied to clipboard

Challenge: Existing studies have focused on enhancing the factualness of large language models using context knowledge.
Approach: They propose to use ChatGPT to construct probing datasets that provide diverse and coherent evidence corresponding to various facts.
Outcome: The proposed model can encode knowledge across different layers, and it is compared with existing models.
FactSearch: An Interactive Agentic Fact Search System for Verifying Large Language Model Outputs (2026.acl-demo)

Copied to clipboard

Challenge: Existing tool-augmented verification systems depend on opaque search APIs, introducing uncontrolled variability into factuality evaluation.
Approach: They propose a reproducibility-oriented agentic fact search system for claim-level factuality verification built on a locally aggregated open-source search infrastructure.
Outcome: The proposed system decomposes model outputs into atomic factual claims, generates targeted search queries, retrieves supporting evidence via a self-hosted meta-search engine, and performs modular verification within a fully configurable pipeline.
Factuality of Large Language Models: A Survey (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are factually incorrect, which limits their applicability in real-world scenarios.
Approach: They analyze existing work to identify major challenges and their associated causes . they propose to evaluate LLMs using a variety of measures to mitigate factual errors .
Outcome: The proposed methods are based on a variety of datasets and proposed strategies to mitigate factual errors.
GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Checking (2025.acl-long)

Copied to clipboard

Challenge: Existing fact-checking methods that use large language models often generate subtle factual errors.
Approach: They propose a fact-checking framework that uses extracted knowledge graphs to enhance text representation.
Outcome: GraphCheck outperforms existing specialized fact-checkers on seven benchmarks spanning general and medical domains . Graph Neural Networks process extracted knowledge graphs as a soft prompt, enabling efficient fact- checking in a single inference call.
OpenFactCheck: A Unified Framework for Factuality Evaluation of LLMs (2024.emnlp-demo)

Copied to clipboard

Challenge: Large language models (LLMs) often produce content that deviates from real-world facts.
Approach: They developed a unified framework to assess the factuality of large language models . open-sourced framework is publicly available as a Python library and web service .
Outcome: OpenFactCheck is open-sourced and publicly released as a Python library and web service.
What Evidence Do Language Models Find Convincing? (2024.acl-long)

Copied to clipboard

Challenge: Current retrieval-augmented language models are tasked with subjective, contentious, and conflicting queries.
Approach: They construct a dataset that pairs controversial queries with real-world evidence documents . they find current models rely heavily on relevance of a website to the query .
Outcome: The proposed dataset pairs controversial queries with real-world evidence documents that contain different facts, arguments, and answers.
Logic Haystacks: Probing LLMs’ Long-Context Logical Reasoning (Without Easily Identifiable Unrelated Padding) (2026.eacl-short)

Copied to clipboard

Challenge: Recent large language models claim long context windows, but evaluations often involve simple retrieval tasks or synthetic tasks padded with irrelevant text.
Approach: They use grammars to generate simplified English with logical representations to create long input text while controlling its semantics.
Outcome: The proposed model performs better with realistic distractors than with standard models.
Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models generate naturally sounding answers over a broad range of human inquiries, but they often generate answers that contradict real-world facts.
Approach: They propose a framework for annotating and evaluating the factuality of large language models . they propose 'factcheck-bench' which provides a multi-stage annotation scheme .
Outcome: The proposed framework outperforms several popular LLM fact-checkers in claim, sentence, and document levels.
Self-Checker: Plug-and-Play Modules for Fact-Checking with Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: Existing methods for fact-checking text generated by large language models are expensive and time-consuming.
Approach: They propose a plug-and-play framework that harnesses large language models for efficient fact-checking in a few-shot manner.
Outcome: The proposed framework is compared with state-of-the-art models and shows that it can be used to speed up fact-checking in a few-shot manner.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations