Extract and Aggregate: A Novel Domain-Independent Approach to Factual Data Verification (D19-66)
Copied to clipboard
| Challenge: | Existing methods to verify information are used to verify factual data . a domain-independent fact checking system can solve the problem entirely or at the individual stages. |
| Approach: | They propose a domain-independent fact checking system that can solve the verification problem entirely or at the individual stages. |
| Outcome: | The proposed model can achieve a score on par with state-of-the-art models based on specific datasets . it can be used to verify the truth or falsity of the fact, the authors say . |
Similar Papers
Constrained Fact Verification for FEVER (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fact verification rely on extracted evidence, but there is little work on understanding the reasoning process. |
| Approach: | They propose a method that enforces a closed-world reliance on extracted evidence to verify a claim's factuality. |
| Outcome: | The proposed model outperforms existing models on the FEVER shared task and shows that it is more accurate than previous models. |
FEVER: a Large-scale Dataset for Fact Extraction and VERification (N18-1)
Copied to clipboard
| Challenge: | 185,445 claims generated by altering sentences from Wikipedia are verified without knowledge of the sentence they were derived from. |
| Approach: | They propose a publicly available dataset for verification against textual sources, FEVER: Fact Extraction and VERification. |
| Outcome: | The proposed dataset achieves 31.87% accuracy on labeling a claim accompanied by the correct evidence, compared to 50.91% if we ignore the evidence. |
Towards Effective Extraction and Evaluation of Factual Claims (2025.acl-long)
Copied to clipboard
| Challenge: | Lack of a standardized evaluation framework impedes assessment and comparison of claim extraction methods. |
| Approach: | They propose a framework for evaluating claim extraction in the context of fact-checking . they also introduce Claimify, an LLM-based claim extraction method . |
| Outcome: | The proposed evaluation framework outperforms existing methods in the evaluation of claim extraction methods. |
DeSePtion: Dual Sequence Prediction and Adversarial Examples for Improved Fact-Checking (2020.acl-main)
Copied to clipboard
Christopher Hidey, Tuhin Chakrabarty, Tariq Alhindi, Siddharth Varia, Kriste Krstovski, Mona Diab, Smaranda Muresan
| Challenge: | Fact Extraction and Verification datasets provide a resource for end-to-end fact-checking, requiring retrieval of evidence from Wikipedia to validate a veracity prediction. |
| Approach: | They propose a system that is resilient to attacks by multiple propositions, temporal reasoning, ambiguity and lexical variation and a sequence of evidence sentences and veracity relation predictions. |
| Outcome: | The proposed system is resilient to three realistic “attacks” and obtains state-of-the-art results due to improved evidence retrieval. |
Enhancing Structured Evidence Extraction for Fact Verification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Open-domain fact verification requires extracting and integrating both structured and unstructured evidence to verify a claim. |
| Approach: | They propose a method to enhance the extraction of structured evidence by leveraging the row and column semantics of tables. |
| Outcome: | The proposed method achieves evidence recall of 60.01% on the test set, higher than the previous state-of-the-art method. |
Improving Evidence Retrieval for Automated Explainable Fact-Checking (2021.naacl-demos)
Copied to clipboard
| Challenge: | Automated fact-checking on a large scale is time consuming and intractable. |
| Approach: | They propose a three-stage automated fact-checking system using evidence retrieval and selection methods to improve evidence recall in a noisy environment. |
| Outcome: | The proposed system can verify open-domain claims using results from web search engines. |
Topic-Aware Evidence Reasoning and Stance-Aware Aggregation for Fact Verification (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fact verification focus on analyzing semantic interaction between claim and evidence but fail to capture their topical consistency . Existing models focus on the aggregation of multiple pieces of evidence without considering their implicit stances to the claim, thereby introducing spurious information. |
| Approach: | They propose a topic-aware evidence reasoning and stance-again aggregation model that checks topical consistency between claims and evidence. |
| Outcome: | The proposed model outperforms state-of-the-art models on two benchmark datasets. |
Adapting Open Domain Fact Extraction and Verification to COVID-FACT through In-Domain Language Modeling (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to verify scientifically false online information are limited by the lack of training data in the scientific domain. |
| Approach: | They propose an in-domain language modeling method for fact extraction and verification systems . they use SCIFACT to extract scientifically false online information . |
| Outcome: | The proposed method improves accuracy 30% on SCIFACT dataset . state-of-the-art model achieves only 46.6% precision, which is hard to be trusted for users. |
Integrating Stance Detection and Fact Checking in a Unified Corpus (N18-2)
Copied to clipboard
| Challenge: | Existing methods for fact checking are not supported by existing datasets, which treat fact checking, document retrieval, source credibility, stance detection and rationale extraction as independent tasks. |
| Approach: | They propose to implement automatic fact checking on an Arabic fact checking corpus, which is the first of its kind. |
| Outcome: | The proposed approach is based on an Arabic fact checking corpus, the first of its kind. |
UnifEE: Unified Evidence Extraction for Fact Verification (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing models extract evidence in both sentences and table cells from Wikipedia dumps, ignoring potential connections between them. |
| Approach: | They propose a model which uses a mixed evidence graph to extract the evidence in both formats without manually designed conversion rules. |
| Outcome: | The proposed model outperforms existing models and improves the verification step. |