“Image, Tell me your story!” Predicting the original meta-context of visual misinformation (2024.emnlp-main)
Copied to clipboard
| Challenge: | a surge of visual misinformation poses a growing threat to our society. |
| Approach: | They propose to use images to contextualize images to establish original meta-context . they use a framework that collects evidence and questions from the open web to ground the image . |
| Outcome: | The proposed approach helps human fact-checkers identify misinformation . it uses image contextualization to establish the original meta-context of the image . |
Similar Papers
COVE: COntext and VEracity prediction for out-of-context images (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing automated fact-checking methods fail to tackle both objectives explicitly. |
| Approach: | They propose a method that predicts first the true COntext of the image and then uses it to predict the VEracity of the caption. |
| Outcome: | The proposed method beats the SOTA context prediction model on all context items, often by more than five percentage points, and is reusable and interpretable to verify new out-of-context captions for the same image. |
Fact-Checking Meets Fauxtography: Verifying Claims About Images (D19-1)
Copied to clipboard
| Challenge: | Recent explosion of false claims in social media has led to manual fact-checking initiatives . however, existing methods are inadequate to deal with the growing number of false content claims. |
| Approach: | They propose to model claims about images using a new dataset to examine the relationship between the image and the claim. |
| Outcome: | The proposed method improves on the baseline and will enable future research on fact-checking claims about images. |
The Role of Context in Detecting Previously Fact-Checked Claims (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent years have seen the proliferation of disinformation and fake news online. |
| Approach: | They propose to model the context of a political debate and the contexts of the document describing the fact-checked claim. |
| Outcome: | The proposed model improves on the state-of-the-art model by modeling the context of the claim . the experimental results show that the model can provide 10+ points of improvement over the state of the art model . |
Multimodal Automated Fact-Checking: A Survey (2023.findings-emnlp)
Copied to clipboard
Mubashara Akhtar, Michael Schlichtkrull, Zhijiang Guo, Oana Cocarascu, Elena Simperl, Andreas Vlachos
| Challenge: | Existing studies on automated fact-checking focus on text, but they focus on a single modality, text . multimodal misinformation is perceived as more credible by humans and spreads faster than text-only counterparts. |
| Approach: | They propose a framework for automated fact-checking that includes subtasks unique to multimodal misinformation. |
| Outcome: | The proposed framework includes subtasks unique to multimodal misinformation. |
Structurizing Misinformation Stories via Rationalizing Fact-Checks (2021.acl-long)
Copied to clipboard
| Challenge: | Existing studies on misinformation include a coarse concept of misinformation . key phrases in fact-check articles that identify misinformation types act as rationales . |
| Approach: | They propose to use fact-check articles to structure misinformation stories by leveraging fact-search articles. |
| Outcome: | The proposed model uses key phrases in fact-check articles to identify misinformation types and rationalize them . the results compare misinformation stories between the 2016/2020 elections and the COVID-19 pandemics . |
NewsCLIPpings: Automatic Generation of Out-of-Context Multimodal Media (2021.emnlp-main)
Copied to clipboard
| Challenge: | a threat scenario where an image is used out of context to support a narrative is proposed. |
| Approach: | They propose a dataset where both image and text are unmanipulated but mismatched . they benchmark several state-of-the-art multimodal models on their dataset . |
| Outcome: | The proposed dataset shows that machine-driven image repurposing is now a realistic threat . it provides samples that represent challenging instances of mismatch between text and image . |
Can Community Notes Replace Professional Fact-Checkers? (2025.acl-short)
Copied to clipboard
| Challenge: | Fact-checkers are crucial in combating misinformation on social media . however, community moderation is often employed in parallel due to the scale of misleading content shared online. |
| Approach: | They use language models to annotate Twitter/X community notes with attributes such as topic, cited sources, and whether they refute misinformation claims. |
| Outcome: | The results show that community notes cite fact-checking sources up to five times more than previously reported. |
Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checking (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing studies on detecting manipulated or fake images focus on identifying manipulated and false images. |
| Approach: | They propose a novel task, chart-based fact-checking, to validate textual, structural and visual information of charts to determine the veracity of textual claims. |
| Outcome: | The proposed model outperforms existing models in vision-language tests with 63.8% accuracy. |
The Intended Uses of Automated Fact-Checking Artefacts: Why, How and Who (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Automated fact-checking is often presented as an epistemic tool fact-seekers, social media consumers, and other stakeholders can use to fight misinformation. |
| Approach: | They analyse 100 highly-cited papers and annotate epistemic elements related to intended use, i.e., means, ends, and stakeholders. |
| Outcome: | The proposed strategies are often left out of the literature and lack empirical backing. |
Edited Media Understanding Frames: Reasoning About the Intent and Implications of Visual Misinformation (2021.acl-long)
Copied to clipboard
| Challenge: | Edited media frames are structured annotations with respect to intents, emotional reactions, attacks on individuals, and the implications of disinformation. |
| Approach: | They propose a new formalism to understand visual media manipulation as structured annotations with respect to intents, emotional reactions, attacks on individuals, and the implications of disinformation. |
| Outcome: | The proposed model obtains promising results on a dataset with 56k question-answer pairs written in rich natural language. |