| Challenge: | Existing benchmark datasets suffer from leakage or evidence incompleteness, limiting the realism of current evaluations. |
| Approach: | They propose an agentic framework that iteratively generates and answers sub-questions to verify different aspects of the claim before finally generating the label. |
| Outcome: | The proposed system outperforms existing methods by 57.5% on Politi-Fact-Only and 3.05% on the widely used HOVER datasets. |
Similar Papers
Large Language Models Require Curated Context for Reliable Political Fact-Checking—Even with Reasoning and Web Search (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have raised hopes for automated end-to-end fact-checking, but prior studies report mixed results. |
| Approach: | They evaluate 15 large language models on 6,000 claims fact-checked by PolitiFact . standard models perform poorly, reasoning offers minimal benefits, and web search provides only moderate gains . |
| Outcome: | The models predict claim veracity and a curated RAG system improved macro F1 by 233% on average across model variants. |
FactSearch: An Interactive Agentic Fact Search System for Verifying Large Language Model Outputs (2026.acl-demo)
Copied to clipboard
| Challenge: | Existing tool-augmented verification systems depend on opaque search APIs, introducing uncontrolled variability into factuality evaluation. |
| Approach: | They propose a reproducibility-oriented agentic fact search system for claim-level factuality verification built on a locally aggregated open-source search infrastructure. |
| Outcome: | The proposed system decomposes model outputs into atomic factual claims, generates targeted search queries, retrieves supporting evidence via a self-hosted meta-search engine, and performs modular verification within a fully configurable pipeline. |
PolitNuggets: Benchmarking Agentic Discovery of Long-Tail Political Facts (2026.acl-long)
Copied to clipboard
| Challenge: | Large Reasoning Models (LRMs) are embedded in agentic frameworks and are under-evaluated. |
| Approach: | They propose a multilingual benchmark for agentic information synthesis using PolitNuggets . they standardize evaluation with an optimized Supervisor–Searcher multi-agent system . |
| Outcome: | The proposed model can discover and synthesize "long-tail" facts from dispersed sources. |
AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotators (2024.acl-long)
Copied to clipboard
| Challenge: | generative AI is a counter-measure to misinformation, but factual claim detection suffers from inconsistency in definitions and high cost of manual annotation. |
| Approach: | They propose a framework that assists in the annotation of factual claims with the help of large language models. |
| Outcome: | The proposed framework can be used to annotate factual claims with the help of large language models and can work with or without expert supervision. |
VeriTaS: The First Dynamic Benchmark for Multimodal Automated Fact-Checking (2026.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for evaluating AFC systems are limited in terms of task scope, modalities, domain, language diversity, realism, or coverage of misinformation types. |
| Approach: | They propose to use Verified Theses and Statements (VeriTaS) to evaluate AFC systems that are static and subject to data leakage as claims enter pretraining corpora. |
| Outcome: | The proposed system is robust under large-scale pretraining of foundation models and can be updated in the future. |
FACT-AUDIT: An Adaptive Multi-Agent Framework for Dynamic Fact-Checking Evaluation of Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing fact-checking evaluation methods rely on static datasets and classification metrics, which fail to evaluate justification production and uncover the nuanced limitations of LLMs. |
| Approach: | They propose a framework that adaptively and dynamically assesses LLMs’ fact-checking capabilities by incorporating justification production alongside verdict prediction. |
| Outcome: | Experiments show that the framework differentiates among state-of-the-art LLMs, providing valuable insights into model strengths and limitations in model-centric fact-checking analysis. |
ClaimLens: Automated, Explainable Fact-Checking on Voting Claims Using Frame-Semantics (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Existing fact-checking solutions lack transparency and explainability . a lack of transparency can make it difficult for users to trust and understand the reasoning behind the outcomes. |
| Approach: | They propose an automated fact-checking system focused on voting-related factual claims that leverages frame-semantic parsing to provide structured and interpretable fact verification. |
| Outcome: | The proposed system can extract relevant information from voting-related factual claims using public records and Vote semantic frame. |
The Missing Parts: Augmenting Fact Verification with Half Truth Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing fact verification systems assess whether a claim is true or false . but many real-world claims are half-truths due to omission of critical context . a new framework that detects omitted information can improve existing fact-checking pipelines . |
| Approach: | They propose a framework that detects omission-based misinformation by aligning evidence and inferring implied intent. |
| Outcome: | The proposed framework boosts Half-True classification F1 by up to 16 points . it can be integrated into existing fact-checking pipelines and improves performance across strong baselines. |
UrduFactCheck: An Agentic Fact-Checking Framework for Urdu with Evidence Boosting and Benchmarking (2025.findings-emnlp)
Copied to clipboard
Sarfraz Ahmad, Hasan Iqbal, Momina Ahsan, Numaan Naeem, Muhammad Ahsan Riaz Khan, Arham Riaz, Muhammad Arslan Manzoor, Yuxia Wang, Preslav Nakov
| Challenge: | Existing automated fact-checking systems are predominantly developed for English . Existing systems focus on claim verification, but UrduFactQA targets factuality . |
| Approach: | They propose two hand-annotated benchmarks to enable fact-checking and factual consistency evaluation in Urdu. |
| Outcome: | The proposed benchmarks are the first of their kind for Urdu and are available online. |
RU22Fact: Optimizing Evidence for Multilingual Explainable Fact-Checking on Russia-Ukraine Conflict (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to verify factuality of claims do not provide sufficient evidence for explainable fact-checking systems. |
| Approach: | They propose a method to automatically retrieve and summarize evidence from the Web and a novel multilingual explainable fact-checking dataset on the Russia-Ukraine conflict in 2022. |
| Outcome: | The proposed method can retrieve and summarize evidence from the Web and generate explanations in 16 languages. |