| Challenge: | Existing models extract evidence in both sentences and table cells from Wikipedia dumps, ignoring potential connections between them. |
| Approach: | They propose a model which uses a mixed evidence graph to extract the evidence in both formats without manually designed conversion rules. |
| Outcome: | The proposed model outperforms existing models and improves the verification step. |
Similar Papers
Dual-Channel Evidence Fusion for Fact Verification over Texts and Tables (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing fact extraction and verification tasks only consider evidence of a single format . Existing models convert evidence into either sentences or tables, thus losing context information . |
| Approach: | They propose a Dual Channel Unified Format fact verification model which unifies various evidence into parallel streams, i.e., natural language sentences and a global evidence table, simultaneously. |
| Outcome: | The proposed model outperforms existing models in two formats by a large margin . it makes the most of existing tables and tables to absorb evidence of two formats . |
Enhancing Structured Evidence Extraction for Fact Verification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Open-domain fact verification requires extracting and integrating both structured and unstructured evidence to verify a claim. |
| Approach: | They propose a method to enhance the extraction of structured evidence by leveraging the row and column semantics of tables. |
| Outcome: | The proposed method achieves evidence recall of 60.01% on the test set, higher than the previous state-of-the-art method. |
FEVER: a Large-scale Dataset for Fact Extraction and VERification (N18-1)
Copied to clipboard
| Challenge: | 185,445 claims generated by altering sentences from Wikipedia are verified without knowledge of the sentence they were derived from. |
| Approach: | They propose a publicly available dataset for verification against textual sources, FEVER: Fact Extraction and VERification. |
| Outcome: | The proposed dataset achieves 31.87% accuracy on labeling a claim accompanied by the correct evidence, compared to 50.91% if we ignore the evidence. |
Extract and Aggregate: A Novel Domain-Independent Approach to Factual Data Verification (D19-66)
Copied to clipboard
| Challenge: | Existing methods to verify information are used to verify factual data . a domain-independent fact checking system can solve the problem entirely or at the individual stages. |
| Approach: | They propose a domain-independent fact checking system that can solve the verification problem entirely or at the individual stages. |
| Outcome: | The proposed model can achieve a score on par with state-of-the-art models based on specific datasets . it can be used to verify the truth or falsity of the fact, the authors say . |
EX-FEVER: A Dataset for Multi-hop Explainable Fact Verification (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on fact verification lack a high-quality dataset for explainability . existing systems lack evidence retrieval and veracity prediction, limiting the ability to verify a claim . |
| Approach: | They propose a dataset for multi-hop explainable fact verification that summarises and modifies Wikipedia documents. |
| Outcome: | The proposed dataset aims to improve the accuracy of multi-hop explainable fact verification systems. |
Bridging Textual and Tabular Worlds for Fact Verification: A Lightweight, Attention-Based Model (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing fact-checking systems rely on extensive preprocessing and rule-based transformations, leading to potential context loss or misleading encodings. |
| Approach: | They propose a simple yet powerful model that nullifies the need for modality conversion, thereby preserving the original evidence’s context. |
| Outcome: | The proposed model nullifies the need for modality conversion, preserving the original evidence’s context. |
Constrained Fact Verification for FEVER (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fact verification rely on extracted evidence, but there is little work on understanding the reasoning process. |
| Approach: | They propose a method that enforces a closed-world reliance on extracted evidence to verify a claim's factuality. |
| Outcome: | The proposed model outperforms existing models on the FEVER shared task and shows that it is more accurate than previous models. |
GLAF: Global-to-Local Aggregation and Fission Network for Semantic Level Fact Verification (2022.coling-1)
Copied to clipboard
| Challenge: | Existing fact verification models lack fine-grained reasoning over key entities . GLAF uses local fission reasoning to capture latent logical relations between clues . |
| Approach: | They propose a global-to-local fission and fissional network to capture latent logical relations hidden in multiple evidence clues. |
| Outcome: | The proposed network achieves state-of-the-art on a FEVER dataset with a 77.62% FEVER score. |
DeSePtion: Dual Sequence Prediction and Adversarial Examples for Improved Fact-Checking (2020.acl-main)
Copied to clipboard
Christopher Hidey, Tuhin Chakrabarty, Tariq Alhindi, Siddharth Varia, Kriste Krstovski, Mona Diab, Smaranda Muresan
| Challenge: | Fact Extraction and Verification datasets provide a resource for end-to-end fact-checking, requiring retrieval of evidence from Wikipedia to validate a veracity prediction. |
| Approach: | They propose a system that is resilient to attacks by multiple propositions, temporal reasoning, ambiguity and lexical variation and a sequence of evidence sentences and veracity relation predictions. |
| Outcome: | The proposed system is resilient to three realistic “attacks” and obtains state-of-the-art results due to improved evidence retrieval. |
Team DOMLIN: Exploiting Evidence Enhancement for the FEVER Shared Task (D19-66)
Copied to clipboard
| Challenge: | Existing methods of fact checking are based on the assignment of a truth value to a given (factual) statement, and therefore it is desirable to have access to the evidence used to reach an assignment. |
| Approach: | They propose a two-staged sentence selection strategy to account for examples in the dataset where evidence is not only conditioned on the claim, but also on previously retrieved evidence. |
| Outcome: | The proposed system beats the top performing systems of the first FEVER challenge which act as a baseline, beating 64.21% of the top-performing systems. |