ClaimDiff: Comparing and Contrasting Claims on Contentious Issues (2023.findings-acl)
Copied to clipboard
| Challenge: | Using fact verification tasks, however, can not detect subtle differences in factually consistent claims, which might bias the readers. |
| Approach: | They propose a novel dataset that primarily focuses on comparing the nuance between claim pairs. |
| Outcome: | The proposed dataset shows that human-labeled 2,941 claim pairs are weaker than baselines, showing a 19% absolute gap with the baselines. |
Similar Papers
Fact-Checking Meets Fauxtography: Verifying Claims About Images (D19-1)
Copied to clipboard
| Challenge: | Recent explosion of false claims in social media has led to manual fact-checking initiatives . however, existing methods are inadequate to deal with the growing number of false content claims. |
| Approach: | They propose to model claims about images using a new dataset to examine the relationship between the image and the claim. |
| Outcome: | The proposed method improves on the baseline and will enable future research on fact-checking claims about images. |
Seeing Things from a Different Angle:Discovering Diverse Perspectives about Claims (N19-1)
Copied to clipboard
| Challenge: | a number of fact checking techniques are used to identify and eliminate biases in text data. |
| Approach: | They propose to use search engines to expand and diversify a dataset of claims, perspectives and evidence to address a selection bias. |
| Outcome: | The proposed approach outperforms existing methods in a language understanding task. |
Fact Checking or Psycholinguistics: How to Distinguish Fake and True Claims? (D19-66)
Copied to clipboard
| Challenge: | Using psycholinguistic features to distinguish lies from true statements is a difficult task and a problem to be solved. |
| Approach: | They compare psycholinguistic text features with fact checking approaches to distinguish lies from true statements using data from a large ongoing study. |
| Outcome: | The proposed methods outperform both fact checking and human baselines but the accuracy is not high. |
ClaimPortal: Integrated Monitoring, Searching, Checking, and Analytics of Factual Claims on Twitter (P19-3)
Copied to clipboard
Sarthak Majithia, Fatma Arslan, Sumeet Lubal, Damian Jimenez, Priyank Arora, Josue Caraballo, Chengkai Li
| Challenge: | ClaimPortal is a web-based platform for monitoring, searching, checking and analyzing factual claims on Twitter from the American political domain. |
| Approach: | They present a web-based platform for monitoring, searching, checking and analyzing English factual claims on Twitter from the American political domain. |
| Outcome: | The proposed platform can monitor, search, check, and analyze English factual claims on Twitter from the political domain. |
NewsClaims: A New Benchmark for Claim Detection from News with Attribute Knowledge (2022.emnlp-main)
Copied to clipboard
Revanth Gangi Reddy, Sai Chetan Chinthakindi, Zhenhailong Wang, Yi Fung, Kathryn Conger, Ahmed ELsayed, Martha Palmer, Preslav Nakov, Eduard Hovy, Kevin Small, Heng Ji
| Challenge: | Current claims detection methods focus on sentence analysis, ignoring other attributes . a key element of identifying misinformation is detecting the claims and the arguments that have been presented. |
| Approach: | They propose a benchmark for attribute-aware claim detection in the news domain . they extend the problem to include extraction of additional attributes related to each claim . |
| Outcome: | The proposed system performs well on the test, but human performance is still poor. |
How Robust are Fact Checking Systems on Colloquial Claims? (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing fact checking systems that perform well on colloquial claims significantly degenerate on collotic claims with the same semantics. |
| Approach: | They propose to transfer the styles of claims from FEVER into colloquialism to investigate fact checking systems on colloqual claims. |
| Outcome: | The proposed system significantly degenerates on colloquial claims with the same semantics. |
A Systematic Survey of Claim Verification: Corpora, Systems, and Case Studies (2025.findings-emnlp)
Copied to clipboard
| Challenge: | This survey analyses 198 studies published between January 2022 and March 2025 . |
| Approach: | This survey synthesizes recent advances in CV corpus creation and system design. |
| Outcome: | The results of this study are synthesized from 198 studies published between January 2022 and March 2025. |
Profiling News Media for Factuality and Bias Using LLMs and the Fact-Checking Methodology of Human Experts (2025.findings-acl)
Copied to clipboard
| Challenge: | Important efforts to characterize news media outlets in terms of their political bias and factuality are labor-intensive and prone to human biases. |
| Approach: | They propose a method that emulates criteria used by professional fact-checkers to assess the factuality and political bias of an entire outlet. |
| Outcome: | The proposed method improves on baselines and with multiple LLMs. |
FaVIQ: FAct Verification from Information-seeking Questions (2022.acl-long)
Copied to clipboard
| Challenge: | Existing fact verification datasets with crowdsourced claims introduce subtle biases that are difficult to control for. |
| Approach: | They construct a large-scale fact verification dataset with ambiguous questions . they use a corpus of 188k claims to construct false and true claims . |
| Outcome: | The proposed dataset outperforms models trained on the dataset FEVER or in-domain data by up to 17% absolute. |
Assisting the Human Fact-Checkers: Detecting All Previously Fact-Checked Claims in a Document (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years have brought us a proliferation of false claims online, which spread fast . fact-checkers have been using automated fact-finding to verify claims . |
| Approach: | They propose a system that can detect claims that can be fact-checked by a given database . they create a manually annotated document dataset and propose evaluation measures . |
| Outcome: | The proposed system achieves sizable performance gains over strong baselines. |