| Challenge: | Existing work on how to automate fact checking relies on information obtained from external sources. |
| Approach: | They propose a fluency-preserving method for omitting information from the evidence at the constituent and sentence level and a diagnostic dataset for FC with omitted evidence. |
| Outcome: | The proposed method improves evidence sufficiency prediction by 17.8 F1 score and 2.6 F1 scores. |
Similar Papers
Claim Check-Worthiness Detection as Positive Unlabelled Learning (2020.findings-emnlp)
Copied to clipboard
| Challenge: | a unified approach to claim check-worthiness detection is a critical component of fact checking systems. |
| Approach: | They propose a unified approach which corrects for misinformation by positive unlabelled learning . they propose citation needed detection from Wikipedia and a ranking task which is a critical component of automatic fact checking systems. |
| Outcome: | The proposed method outperforms the state of the art in two of the three tasks studied in English. |
Explainable Automated Fact-Checking: A Survey (2020.coling-main)
Copied to clipboard
| Challenge: | Steady progress has been made in fact-checking and its orthogonal tasks. |
| Approach: | They propose to use fact-checking explanations to explain predictions by comparing existing explanations against desirable properties to find out what makes for good explanations. |
| Outcome: | The proposed explanations are compared against desirable properties and show how they may lead to improvements in the research area. |
The Missing Parts: Augmenting Fact Verification with Half Truth Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing fact verification systems assess whether a claim is true or false . but many real-world claims are half-truths due to omission of critical context . a new framework that detects omitted information can improve existing fact-checking pipelines . |
| Approach: | They propose a framework that detects omission-based misinformation by aligning evidence and inferring implied intent. |
| Outcome: | The proposed framework boosts Half-True classification F1 by up to 16 points . it can be integrated into existing fact-checking pipelines and improves performance across strong baselines. |
Automated Justification Production for Claim Veracity in Fact Checking: A Survey on Architectures and Approaches (2024.acl-long)
Copied to clipboard
| Challenge: | Current research focuses on predicting claim veracity through metadata analysis and language scrutiny, with an emphasis on justifying verdicts. |
| Approach: | They propose a comprehensive taxonomy for categorizing works based on various criteria and propose scalable methodologies for improving fact-checking explainability. |
| Outcome: | The proposed taxonomy identifies challenges while proposing future directions in fact-checking explainability. |
Automated Fact Checking: Task Formulations, Methods and Future Directions (C18-1)
Copied to clipboard
| Challenge: | Recent research on fact checking has focused on misinformation . however, relevant papers and articles have been published in research communities that are unaware of each other and use inconsistent terminology. |
| Approach: | They propose avenues for future NLP research on automated fact checking . they highlight the use of evidence as an important distinguishing factor . |
| Outcome: | The proposed methods unify the task formulations and methodologies across papers and authors. |
Evidence-based Factual Error Correction (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to correct factual errors are limited to labeled claims . a recent task of fact verification has attracted significant attention . |
| Approach: | They propose a task of factual error correction that performs edits to a claim so that the generated rewrite is better supported by evidence. |
| Outcome: | The proposed method produces accurate factual error corrections for 5x more instances in human evaluation and a .125 increase in SARI score. |
Unknown Claims: Generation of Fact-Checking Training Examples from Unstructured and Structured Data (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fact-checking are labor-intensive and time-consuming. |
| Approach: | They propose a framework that generates training instances for FC systems automatically using textual and tabular content. |
| Outcome: | The proposed framework generates training instances for FC systems using textual and tabular content. |
Generating Fact Checking Explanations (2020.acl-main)
Copied to clipboard
| Challenge: | Existing work on automated fact checking is concerned with predicting the veracity of claims based on metadata, social network spread, language used in claims, and, more recently, evidence supporting or denying claims. |
| Approach: | They propose to combine the generation of justifications for verdicts on claims with the multi-task model to optimize both objectives at the same time rather than training them separately. |
| Outcome: | The proposed model improves the informativeness, coverage and overall quality of the generated explanations, rather than training them separately. |
MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claims (D19-1)
Copied to clipboard
Isabelle Augenstein, Christina Lioma, Dongsheng Wang, Lucas Chaves Lima, Casper Hansen, Christian Hansen, Jakob Grue Simonsen
| Challenge: | Existing efforts to verify factual claims are limited by small datasets or artificially constructed datasets. |
| Approach: | They propose to use the largest publicly available dataset of naturally occurring factual claims for automatic claim verification. |
| Outcome: | The proposed model outperforms baseline models and evidence pages significantly. |
Counterfactual Debiasing for Fact Verification (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for debiasing factchecking models learn such biases instead of understanding the semantic relationship between the claim and evidence. |
| Approach: | They propose a counterfactual framework CLEVER which is augmentation-free and mitigates biases on the inference stage. |
| Outcome: | The proposed method is augmentation-free and mitigates biases on the inference stage. |