Table-Text Alignment: Explaining Claim Verification Against Tables in Scientific Papers (2025.findings-emnlp)
Copied to clipboard
| Challenge: | predicting the final label alone is insufficient and offers limited interpretability. |
| Approach: | They propose to reframe table–text alignment as an explanation task requiring models to identify the table cells essential for claim verification. |
| Outcome: | The proposed taxonomy improves claim verification performance and most LLMs fail to recover human-aligned rationales, suggesting that their predictions do not stem from faithful reasoning. |
Similar Papers
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables (2023.emnlp-main)
Copied to clipboard
| Challenge: | Current scientific fact-checking benchmarks exhibit several shortcomings, such as biases arising from crowd-sourced claims and an over-reliance on text-based evidence. |
| Approach: | They present a dataset of 1.2K expert-verified scientific claims that require compositional reasoning for verification. |
| Outcome: | The proposed model outperforms existing models in table-based pretraining models and large language models. |
Table-based Fact Verification with Self-labeled Keypoint Alignment (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for fact verification rely on graph feature or data augmentation but fail to investigate evidence correlation between statement and table effectively. |
| Approach: | They propose a self-labeled keypoint alignment model to explore correlation between statement and table . they propose integrating a mixture-of experts block to integrate interacted information . |
| Outcome: | The proposed model outperforms the state-of-the-art models and captures interpretable evidence words on three widely-studied datasets. |
ClaimDB: A Fact Verification Benchmark over Large Structured Data (2026.acl-long)
Copied to clipboard
| Challenge: | despite substantial progress in fact-verification benchmarks, this setting remains largely underexplored. |
| Approach: | They propose a fact-verification benchmark where evidence for claims is derived from compositions of millions of records and multiple tables. |
| Outcome: | The proposed benchmarks score below 55% accuracy with 30 state-of-the-art LLMs and are released on github. |
Fact or Fiction: Verifying Scientific Claims (2020.emnlp-main)
Copied to clipboard
David Wadden, Shanchuan Lin, Kyle Lo, Lucy Lu Wang, Madeleine van Zuylen, Arman Cohan, Hannaneh Hajishirzi
| Challenge: | SciFact is a dataset of 1.4K expert-written scientific claims paired with evidence-containing abstracts annotated with labels and rationales. |
| Approach: | They construct a dataset of 1.4K scientific claims paired with evidence-containing abstracts annotated with labels and rationales to test their system. |
| Outcome: | The proposed system can verify claims related to COVID-19 by identifying evidence from the CORD-19 corpus. |
CLAIMCHECK: How Grounded are LLM Critiques of Scientific Papers? (2025.findings-emnlp)
Copied to clipboard
Jiefu Ou, William Gantt Walden, Kate Sanders, Zhengping Jiang, Kaiser Sun, Jeffrey Cheng, William Jurayj, Miriam Wanner, Shaobo Liang, Candice Morgan, Seunghoon Han, Weiqi Wang, Chandler May, Hannah Recknor, Daniel Khashabi, Benjamin Van Durme
| Challenge: | CLAIMCHECK is an annotated dataset of NeurIPS 2023 and 2024 submissions and reviews from OpenReview. |
| Approach: | They annotate NeurIPS 2023 and 2024 submissions and reviews for weaknesses and dispute them for fine-grained labels of validity, objectivity, and type of the identified weaknesses. |
| Outcome: | The proposed dataset is richly annotated by ML experts for weaknesses statements in the reviews and the claims that they dispute, as well as fine-grained labels of validity, objectivity, and type of the identified weaknesses. |
ClaimVer: Explainable Claim-Level Verification and Evidence Attribution of Text Through Knowledge Graphs (2024.findings-emnlp)
Copied to clipboard
Preetam Prabhu Srikar Dammu, Himanshu Naidu, Mouly Dewan, YoungMin Kim, Tanya Roosta, Aman Chadha, Chirag Shah
| Challenge: | Despite the fact that many fact-checking tools lack granularity and explainability, they lack the ability to be useful in various contexts. |
| Approach: | They propose a text validation framework that provides granular explanations for each claim and localizes the specific problematic content to reduce cognitive load. |
| Outcome: | The proposed framework provides granular explanations for each claim prediction and localizes and educates users on the specific content. |
Claim Verification in the Age of Large Language Models: A Survey (2026.acl-srw)
Copied to clipboard
| Challenge: | Recent election cycles have seen a large number of false information spread across social media and news platforms. |
| Approach: | They propose a framework for automated claim verification using Large Language Models and Retrieval Augmented Generation. |
| Outcome: | The proposed frameworks are based on large-scale models and new methods such as Retrieval Augmented Generation (RAG). |
A Systematic Survey of Claim Verification: Corpora, Systems, and Case Studies (2025.findings-emnlp)
Copied to clipboard
| Challenge: | This survey analyses 198 studies published between January 2022 and March 2025 . |
| Approach: | This survey synthesizes recent advances in CV corpus creation and system design. |
| Outcome: | The results of this study are synthesized from 198 studies published between January 2022 and March 2025. |
Towards Effective Extraction and Evaluation of Factual Claims (2025.acl-long)
Copied to clipboard
| Challenge: | Lack of a standardized evaluation framework impedes assessment and comparison of claim extraction methods. |
| Approach: | They propose a framework for evaluating claim extraction in the context of fact-checking . they also introduce Claimify, an LLM-based claim extraction method . |
| Outcome: | The proposed evaluation framework outperforms existing methods in the evaluation of claim extraction methods. |
Abstract, Rationale, Stance: A Joint Model for Scientific Claim Verification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing scientific claim verification models have problems of error propagation among modules and lack of sharing valuable information among modules. |
| Approach: | They propose an approach that jointly learns the modules for the three tasks with a machine reading comprehension framework by including claim information. |
| Outcome: | The proposed approach outperforms existing models on the SciFact dataset on the three tasks of abstract retrieval, rationale selection and stance prediction. |