| Challenge: | Existing methods for fact verification rely on extracted evidence, but there is little work on understanding the reasoning process. |
| Approach: | They propose a method that enforces a closed-world reliance on extracted evidence to verify a claim's factuality. |
| Outcome: | The proposed model outperforms existing models on the FEVER shared task and shows that it is more accurate than previous models. |
Similar Papers
FEVER: a Large-scale Dataset for Fact Extraction and VERification (N18-1)
Copied to clipboard
| Challenge: | 185,445 claims generated by altering sentences from Wikipedia are verified without knowledge of the sentence they were derived from. |
| Approach: | They propose a publicly available dataset for verification against textual sources, FEVER: Fact Extraction and VERification. |
| Outcome: | The proposed dataset achieves 31.87% accuracy on labeling a claim accompanied by the correct evidence, compared to 50.91% if we ignore the evidence. |
DeSePtion: Dual Sequence Prediction and Adversarial Examples for Improved Fact-Checking (2020.acl-main)
Copied to clipboard
Christopher Hidey, Tuhin Chakrabarty, Tariq Alhindi, Siddharth Varia, Kriste Krstovski, Mona Diab, Smaranda Muresan
| Challenge: | Fact Extraction and Verification datasets provide a resource for end-to-end fact-checking, requiring retrieval of evidence from Wikipedia to validate a veracity prediction. |
| Approach: | They propose a system that is resilient to attacks by multiple propositions, temporal reasoning, ambiguity and lexical variation and a sequence of evidence sentences and veracity relation predictions. |
| Outcome: | The proposed system is resilient to three realistic “attacks” and obtains state-of-the-art results due to improved evidence retrieval. |
Extract and Aggregate: A Novel Domain-Independent Approach to Factual Data Verification (D19-66)
Copied to clipboard
| Challenge: | Existing methods to verify information are used to verify factual data . a domain-independent fact checking system can solve the problem entirely or at the individual stages. |
| Approach: | They propose a domain-independent fact checking system that can solve the verification problem entirely or at the individual stages. |
| Outcome: | The proposed model can achieve a score on par with state-of-the-art models based on specific datasets . it can be used to verify the truth or falsity of the fact, the authors say . |
Team DOMLIN: Exploiting Evidence Enhancement for the FEVER Shared Task (D19-66)
Copied to clipboard
| Challenge: | Existing methods of fact checking are based on the assignment of a truth value to a given (factual) statement, and therefore it is desirable to have access to the evidence used to reach an assignment. |
| Approach: | They propose a two-staged sentence selection strategy to account for examples in the dataset where evidence is not only conditioned on the claim, but also on previously retrieved evidence. |
| Outcome: | The proposed system beats the top performing systems of the first FEVER challenge which act as a baseline, beating 64.21% of the top-performing systems. |
EX-FEVER: A Dataset for Multi-hop Explainable Fact Verification (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on fact verification lack a high-quality dataset for explainability . existing systems lack evidence retrieval and veracity prediction, limiting the ability to verify a claim . |
| Approach: | They propose a dataset for multi-hop explainable fact verification that summarises and modifies Wikipedia documents. |
| Outcome: | The proposed dataset aims to improve the accuracy of multi-hop explainable fact verification systems. |
The FEVER2.0 Shared Task (D19-66)
Copied to clipboard
| Challenge: | Existing deep neural models are becoming more complex and difficult to understand and characterize their behaviour. |
| Approach: | They present the results of the second Fact Extraction and VERification (FEVER2.0) Shared Task. |
| Outcome: | The proposed task was based on the second Fact Extraction and VERification (FEVER2.0) shared task. |
COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemic (2021.acl-long)
Copied to clipboard
| Challenge: | a new method for fact-checking is needed to detect disinformation on the web . a dataset COVID-Fact contains 4,086 claims concerning the COVId-19 pandemic . |
| Approach: | They propose a FEVER-like dataset COVID-Fact of 4,086 claims concerning the COVId-19 pandemic . they automatically detect true claims and their source articles and generate counter-claims using automatic methods . |
| Outcome: | The proposed method reduces the cost of building domain-specific datasets for detecting misinformation . the proposed dataset contains 4,086 claims concerning the COVID-19 pandemic . |
Enhancing Structured Evidence Extraction for Fact Verification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Open-domain fact verification requires extracting and integrating both structured and unstructured evidence to verify a claim. |
| Approach: | They propose a method to enhance the extraction of structured evidence by leveraging the row and column semantics of tables. |
| Outcome: | The proposed method achieves evidence recall of 60.01% on the test set, higher than the previous state-of-the-art method. |
Team GPLSI. Approach for automated fact checking (D19-66)
Copied to clipboard
| Challenge: | Automated fact checking is a task for proving news veracity by reliable sources. |
| Approach: | They propose to use triplets to extract sentences and compare them to Wikipedia articles using semantic similarity. |
| Outcome: | The proposed approach is satisfactory but there is room for improvement. |
Evidence Retrieval is almost All You Need for Fact Verification (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing evidence retrieval methods adopt a trivial retrieval strategy, resulting in task-irrelevant evidence and undesirable performance. |
| Approach: | They propose a framework for evidence retrieval and joint fact verification that integrates two modules. |
| Outcome: | The proposed framework improves evidence retrieval and claims verification on a FEVER dataset. |