Article Reranking by Memory-Enhanced Key Sentence Matching for Detecting Previously Fact-Checked Claims (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to detect false claims ignore the characteristics of FC-articles . claims are often quoted to describe checked events, providing lexical information . sentence templates to introduce or debunk claims are common across articles, providing pattern information. |
| Approach: | They propose a model to rerank FC-articles using key sentences and pattern information. |
| Outcome: | The proposed model outperforms existing methods on two real-world datasets showing that key sentences can be used to predict if an article fact-checks the given claim. |
Similar Papers
Assisting the Human Fact-Checkers: Detecting All Previously Fact-Checked Claims in a Document (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years have brought us a proliferation of false claims online, which spread fast . fact-checkers have been using automated fact-finding to verify claims . |
| Approach: | They propose a system that can detect claims that can be fact-checked by a given database . they create a manually annotated document dataset and propose evaluation measures . |
| Outcome: | The proposed system achieves sizable performance gains over strong baselines. |
That is a Known Lie: Detecting Previously Fact-Checked Claims (2020.acl-main)
Copied to clipboard
| Challenge: | a large number of fact-checked claims have been accumulated over the years . despite the importance of fact checking, it has been largely ignored by the research community . |
| Approach: | They propose to automate fact-checking by focusing on claims that have already been fact-tested . they propose to use specialized datasets to compare different methods . |
| Outcome: | The proposed task shows that it improves over state-of-the-art methods. |
Evidence Retrieval for Fact Verification using Multi-stage Reranking (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evidence retrieval methods are limited by single-stage evidence extraction. |
| Approach: | They propose to use a multi-stage reranking paradigm to enhance the fact verification process by increasing the recall of sentences by 7.85%, tables by 8.29% and cells by 3% compared to the current state-of-the-art. |
| Outcome: | The proposed system outperforms state-of-the-art models and achieves a 93.63% recall rate for Wikipedia pages. |
Natural Logic-guided Autoregressive Multi-hop Document Retrieval for Fact Verification (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent evidence retrieval approaches rely on heuristics and assume hyperlinks between documents. |
| Approach: | They propose a retrieval method that combines a retriever and a proof system that reranks documents and reorders them . |
| Outcome: | The proposed method exceeds or is on par with the current state-of-the-art on FEVER, HoVer and FEVEROUS-S while using 5 to 10 times less memory than competing systems. |
CrowdChecked: Detecting Previously Fact-Checked Claims in Social Media (2022.aacl-main)
Copied to clipboard
| Challenge: | Existing systems to automate fact-checking lack credibility in the eyes of the users. |
| Approach: | They propose to perform automatic fact-checking by verifying whether an input claim has been fact- checked by professional fact- checkers and to return back an article that explains their decision. |
| Outcome: | The proposed method improves on the CLEF’21 CheckThat! test set by two points absolute. |
ClaimRank: Detecting Check-Worthy Claims in Arabic and English (N18-5)
Copied to clipboard
| Challenge: | ClaimRank is an online system for detecting check-worthy claims . it can be used to prioritize the claims fact-checkers should consider first . |
| Approach: | ClaimRank is an online system for detecting check-worthy claims . it is originally trained on political debates, but can work for any kind of text . authors propose to make automated fact-checking easier by prioritizing claims based on annotations from reputable fact- checking organizations. |
| Outcome: | ClaimRank is an online system for detecting check-worthy claims . it can mimic the sentence selection strategies of reputable fact-checking organizations . |
Harnessing Abstractive Summarization for Fact-Checked Claim Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Social media platforms are becoming battlegrounds for anti-social elements . fact-checking organizations cannot cope with the rapid dissemination of misinformation . a new workflow for fact- checking can be implemented to reduce human time for tasks with high cognition . |
| Approach: | They propose a workflow for detecting previously fact-checked claims that uses abstractive summarization to generate crisp queries. |
| Outcome: | The proposed workflow achieves Recall@5 and MRR of 35% and 0.3, respectively. |
When Claims Evolve: Evaluating and Enhancing the Robustness of Embedding Models Against Misinformation Edits (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing claims-matching systems that use sentence embedding models are not robust to edits as users interact with claims online. |
| Approach: | They propose a perturbation framework that generates valid and natural claim variations and evaluate different mitigation approaches to improve their findings. |
| Outcome: | The proposed framework evaluates embedding models in a multi-stage retrieval pipeline and identifies the effectiveness of mitigation approaches. |
Improving Large-Scale Fact-Checking using Decomposable Attention Models and Lexical Tagging (D18-1)
Copied to clipboard
| Challenge: | Existing pipelines for fact-checking of textual sources are limited . fact- checking of text sources requires a large knowledge base to extract relevant information . |
| Approach: | They propose a neural ranker that dynamically selects sentences to improve evidence retrieval . they incorporate lexical tagging methods into the pipeline framework to simplify the tasks . |
| Outcome: | The proposed model outperforms the existing TF-IDF method on a large-scale fact extraction and verification dataset with speedup. |
MetaSumPerceiver: Multimodal Multi-Document Evidence Summarization for Fact-Checking (2024.acl-long)
Copied to clipboard
| Challenge: | Fact-checking claims on social media platforms poses a significant challenge due to the large volume of new claims constantly being posted without sufficient methods for verification. |
| Approach: | They propose a model that generates claim-specific summaries from multimodal multi-document datasets using a perceiver-based model that is able to handle inputs from multiple modalities of arbitrary lengths. |
| Outcome: | The proposed model outperforms the SOTA approach by 4.6% in the claim verification task on the MOCHEG dataset and shows strong performance on the new multi-document claims dataset. |