Challenge: Existing fact-checking datasets do not provide manual annotations for sentence-level evidence.
Approach: They propose a task-agnostic pipelined system that extracts textual evidence that supports or refutes a factual claim from Wikipedia pages.
Outcome: The proposed system achieves state-of-the-art results on the FEVER dataset.

Similar Papers

A Multi-Level Attention Model for Evidence-Based Fact Checking (2021.findings-acl)

Copied to clipboard

Challenge: Recent state-of-the-art approaches have developed increasingly sophisticated models based on graph structures.
Approach: They propose a simple model that can be trained on sequence structures and can benefit from joint training.
Outcome: The proposed model outperforms the graph-based models on a large-scale dataset for Fact Extraction and VERification.
Hierarchical Multi-head Attentive Network for Evidence-aware Fake News Detection (2021.eacl-main)

Copied to clipboard

Challenge: Existing methods to fact-check information focus on word-level attention or evidence-level focus, which may result in suboptimal performance.
Approach: They propose a Hierarchical Multi-head Attentive Network to fact-check textual claims using word-level attention and document-level focus.
Outcome: The proposed model outperforms state-of-the-art methods on two real-word datasets. Improvements over baselines are from 6% to 18%.
Sentence-Level Evidence Embedding for Claim Verification with Hierarchical Attention Networks (P19-1)

Copied to clipboard

Challenge: Claim verification is cumbersome and inefficient for human fact-checkers to find consistent pieces of evidence.
Approach: They propose an end-to-end hierarchical attention network that learns to represent coherent evidence and their semantic relatedness with the claim.
Outcome: The proposed model outperforms state-of-the-art models on three datasets . it is based on a coherence-based attention layer and entailment-based one .
FaGANet: An Evidence-Based Fact-Checking Model with Integrated Encoder Leveraging Contextual Information (2024.lrec-main)

Copied to clipboard

Challenge: Existing evidence-based fact-checking efforts are time-consuming and challenging . however, relying on surface patterns of claims makes it difficult to identify subtle connections between claims and evidence.
Approach: They propose a model that leverages sentence-level attention and graph attention network to enhance accuracy and fusing claims and evidence information for accurate identification of even well-disguised data.
Outcome: The proposed model improves accuracy and state-of-the-art in the evidence-based fact-checking task.
Bridging Textual and Tabular Worlds for Fact Verification: A Lightweight, Attention-Based Model (2024.lrec-main)

Copied to clipboard

Challenge: Existing fact-checking systems rely on extensive preprocessing and rule-based transformations, leading to potential context loss or misleading encodings.
Approach: They propose a simple yet powerful model that nullifies the need for modality conversion, thereby preserving the original evidence’s context.
Outcome: The proposed model nullifies the need for modality conversion, preserving the original evidence’s context.
Hierarchical Evidence Set Modeling for Automated Fact Extraction and Verification (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods for fact extraction and verification combine all evidence sentences to produce redundant information.
Approach: They propose a framework to extract evidence sets and verify a claim to be supported, refuted or not enough info . they propose to encode and attend the claim and evidence sets at different levels of hierarchy .
Outcome: The proposed framework outperforms 7 state-of-the-art methods for fact extraction and verification.
Topic-Aware Evidence Reasoning and Stance-Aware Aggregation for Fact Verification (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for fact verification focus on analyzing semantic interaction between claim and evidence but fail to capture their topical consistency . Existing models focus on the aggregation of multiple pieces of evidence without considering their implicit stances to the claim, thereby introducing spurious information.
Approach: They propose a topic-aware evidence reasoning and stance-again aggregation model that checks topical consistency between claims and evidence.
Outcome: The proposed model outperforms state-of-the-art models on two benchmark datasets.
Reasoning Over Semantic-Level Graph for Fact Checking (2020.acl-main)

Copied to clipboard

Challenge: Existing methods for fact checking use string concatenation or fusing features of isolated evidence sentences.
Approach: They propose a method suitable for reasoning about the semantic-level structure of evidence . they use graph convolutional network and graph attention network to exploit the structure .
Outcome: The proposed method improves claim verification accuracy and FEVER score on a benchmark dataset.
GraphCheck: Multipath Fact-Checking with Entity-Relationship Graphs (2025.findings-emnlp)

Copied to clipboard

Challenge: GraphCheck is a framework for fact-checking complex claims that require multi-hop reasoning . Graphcheck excels in complex scenarios, but may be unnecessarily elaborate for simpler claims .
Approach: They propose a framework that transforms claims into entity-relationship graphs for fact-checking . DP-GraphCheck employs a lightweight strategy selector to choose between direct prompting and GraphCheck adaptively.
Outcome: The proposed framework outperforms existing methods in verification accuracy while achieving strong computational efficiency.
Exploring Listwise Evidence Reasoning with T5 for Fact Verification (2021.acl-short)

Copied to clipboard

Challenge: Existing methods for fact verification use pretrained sequence-to-sequence transformers for sentence selection and label prediction.
Approach: They propose a framework for fact verification that leverages pretrained sequence-to-sequence transformer models for sentence selection and label prediction.
Outcome: The proposed framework scores higher than the second place approach on the blind test set . the proposed framework can be useful for a broader range of NLP tasks, the authors say .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations