Challenge: Toxic memes spread harmful and offensive content and pose a significant challenge in online environments.
Approach: They propose a framework to mitigate toxicity in toxic memes by leveraging a set of pre-trained models that can interpret the visual and textual components of memes.
Outcome: The proposed framework reduces toxicity on publicly available meme datasets by 10-20% compared to the previous methods.

Similar Papers

MemeGuard: An LLM and VLM-based Framework for Advancing Content Moderation via Meme Intervention (2024.acl-long)

Copied to clipboard

Challenge: Existing studies on content moderation of toxic memes focus on text-based content . current research neglects the widespread influence of multimodal content like memes .
Approach: They propose a framework leveraging Large Language Models and Visual Language Model (VLMs) for meme intervention.
Outcome: The proposed framework enables users to generate relevant and effective responses to toxic memes.
DISARM: Detecting the Victims Targeted by Harmful Memes (2022.findings-naacl)

Copied to clipboard

Challenge: DISARM is a framework that uses named-entity recognition and person identification to detect all entities a meme is referring to and then incorporates a novel contextualized deep neural network to classify whether the meme intends to harm these entities.
Approach: They propose a framework that uses named-entity recognition and person identification to detect all entities a meme is referring to and incorporates a novel contextualized deep neural network to classify whether the meme intends to harm them.
Outcome: The proposed framework outperforms 10 unimodal and multimodal systems and reduces error rate of harmful target identification by 9 % absolute over baseline systems.
Enhancing LLM-based Hatred and Toxicity Detection with Meta-Toxic Knowledge Graph (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods to address toxicity issues with large language models are inadequate . lack of domain-specific knowledge leads to false negatives and excessive sensitivity to toxic speech limits freedom of speech.
Approach: They propose a method that leverages graph search on a meta-toxic knowledge graph to enhance hatred and toxicity detection.
Outcome: The proposed method lowers false positive rate and improves toxicity detection performance in out-of-domain scenarios.
Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for harmful meme detection ignore in-depth cognition of meme text and image . authors propose a framework for learning reasonable thoughts from LLMs for better multimodal fusion .
Approach: They propose to use large language models to learn reasonable thoughts from LLMs for better multimodal fusion and lightweight fine-tuning.
Outcome: The proposed approach achieves superior performance than state-of-the-art methods on the harmful meme detection task.
MOMENTA: A Multimodal Framework for Detecting Harmful Memes and Their Targets (2021.findings-emnlp)

Copied to clipboard

Challenge: a growing number of harmful memes are being used for trolling, cyberbullying and abuse . a new approach to detect harmful meme images and texts is emerging .
Approach: They propose a multimodal deep neural network that detects harmful memes . they extend the recently released HarMeme dataset with additional memes and a new topic .
Outcome: The proposed framework outperforms rival methods in detecting harmful memes and their target social entities.
Detecting Harmful Memes and Their Targets (2021.findings-acl)

Copied to clipboard

Challenge: a growing body of research on meme analysis has focused on detecting harmful memes and their social entities . a meme is a form of content that is often harmless and designed to look funny . but its multimodal nature and camouflaged semantics make its analysis challenging .
Approach: They propose to use multimodal models to detect harmful memes and identify social entities that harmful meme targets.
Outcome: The proposed model can detect harmful memes and the social entities they target . the proposed model lacks the appropriate contexts and is poorly validated .
ModelCitizens: Representing Community Voices in Online Safety (2025.emnlp-main)

Copied to clipboard

Challenge: Existing toxic language detection models are trained on annotations that collapse diverse perspectives into a single ground truth.
Approach: They propose to augment social media posts with conversational scenarios to reflect the impact of conversational context on toxicity.
Outcome: The proposed model outperforms existing models on social media with conversational scenarios.
MemeIntel: Explainable Detection of Propagandistic and Hateful Memes (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for label detection and explanation generation have been limited in understanding complex issues . identifying propaganda and hate in memes is essential for combating misinformation and minimizing harm .
Approach: They propose an explanation-enhanced dataset for propaganda memes in Arabic and hateful memes on English to solve these tasks.
Outcome: The proposed model outperforms the current state-of-the-art in label detection and explanation generation.
Unintended Bias Detection and Mitigation in Misogynous Memes (2024.eacl-long)

Copied to clipboard

Challenge: Existing models that detect misogyny are not able to detect unintended biases in memes, perpetuating harmful stereotypes and reinforcing negative attitudes.
Approach: They propose to measure and mitigate unintentional bias in misogynous memes detection models by using a contextualized scene graph-based multimodal network (CTXSGMNet) they also evaluate their generalizability by evaluating their performance on a few benchmark meme datasets.
Outcome: The proposed model achieves state-of-the-art performance on the SemEval-2022 Task 5 (MAMI task) dataset, showcasing its promising performance in terms of Equity of Odds and F1 score.
Meme-ingful Analysis: Enhanced Understanding of Cyberbullying in Memes Through Multimodal Explanations (2024.eacl-long)

Copied to clipboard

Challenge: Recent laws like “right to explanations” have spurred research in developing interpretable models . a recent study has shown that multimodal explanations improve performance in generating textual justifications .
Approach: They propose to use visual and textual modalities to explain why a given meme is cyberbullying . they use a Contrastive Language-Image Pretraining approach to generate textual justifications .
Outcome: The proposed model improves performance in visual and textual explanations and identifies the visual evidence supporting a decision.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations