Challenge: Current approaches focus on isolated meme analysis, either for harmful content detection or standalone interpretation, overlooking a fundamental challenge: the same meme can express different intents depending on its conversational context.
Approach: They propose a benchmark to evaluate how large vision language models understand memes in their original context.
Outcome: The proposed benchmark evaluates how large vision language models understand meme intent in their original context.

Similar Papers

MEMEX: Detecting Explanatory Evidence for Memes via Knowledge-Enriched Contextualization (2023.acl-long)

Copied to clipboard

Challenge: Besides digital archiving of memes and their metadata, there is no efficient way to deduce a meme’s context dynamically.
Approach: They propose a task to mine the context that succinctly explains the background of a meme and a related document to capture cross-modal semantic dependencies between the meme and the context.
Outcome: The proposed dataset outperforms existing systems and shows that it can capture cross-modal semantic dependencies between the meme and the context.
Computational Meme Understanding: A Survey (2024.emnlp-main)

Copied to clipboard

Challenge: Computational Meme Understanding (CMU) is a collection of tasks involving the automated comprehension of memes.
Approach: They propose a comprehensive taxonomy for memes along three dimensions – forms, functions, and topics and introduce three key tasks for Computational Meme Understanding, namely classification, interpretation, and explanation.
Outcome: The proposed model is based on a taxonomy of memes along three dimensions and is compared to existing models and datasets.
MemeQA: Holistic Evaluation for Meme Understanding (2025.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for meme understanding only concern narrow aspects of meme semantics.
Approach: They propose to use multiple-choice questions to evaluate meme comprehension . they use a dataset of over 9,000 multiple-question questions to assess meme comprehension.
Outcome: The proposed model outperforms existing models on meme comprehension . the model makes many errors on memes where proper understanding requires going beyond sentiment .
MemeIntel: Explainable Detection of Propagandistic and Hateful Memes (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods for label detection and explanation generation have been limited in understanding complex issues . identifying propaganda and hate in memes is essential for combating misinformation and minimizing harm .
Approach: They propose an explanation-enhanced dataset for propaganda memes in Arabic and hateful memes on English to solve these tasks.
Outcome: The proposed model outperforms the current state-of-the-art in label detection and explanation generation.
MemeCap: A Dataset for Captioning and Interpreting Memes (2023.emnlp-main)

Copied to clipboard

Challenge: a new dataset aims to understand meme captioning tasks using visual metaphors . vision and language models are proving to be effective in image captioning and visual question answering tasks .
Approach: They present a dataset that contains 6.3K memes and 6.3k meme captions . they show that vision and language models still struggle with visual metaphors despite their advanced capabilities .
Outcome: The proposed dataset contains 6.3K memes along with the title of the post containing the meme, meme captions, literal image caption, and visual metaphors.
Meme-ingful Analysis: Enhanced Understanding of Cyberbullying in Memes Through Multimodal Explanations (2024.eacl-long)

Copied to clipboard

Challenge: Recent laws like “right to explanations” have spurred research in developing interpretable models . a recent study has shown that multimodal explanations improve performance in generating textual justifications .
Approach: They propose to use visual and textual modalities to explain why a given meme is cyberbullying . they use a Contrastive Language-Image Pretraining approach to generate textual justifications .
Outcome: The proposed model improves performance in visual and textual explanations and identifies the visual evidence supporting a decision.
MemeInterpret: Towards an All-in-One Dataset for Meme Understanding (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing research has not explored meme captioning's decomposition into subtasks or its connections to other CMU tasks.
Approach: a new meme corpus is built upon the Facebook Hateful Memes dataset . it contains meme captions, corresponding surface messages and relevant background knowledge .
Outcome: a new corpus of meme captions and surface messages unifies three major categories of CMU tasks for the first time.
Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for harmful meme detection ignore in-depth cognition of meme text and image . authors propose a framework for learning reasonable thoughts from LLMs for better multimodal fusion .
Approach: They propose to use large language models to learn reasonable thoughts from LLMs for better multimodal fusion and lightweight fine-tuning.
Outcome: The proposed approach achieves superior performance than state-of-the-art methods on the harmful meme detection task.
MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencing (2024.findings-acl)

Copied to clipboard

Challenge: Recent studies have focused on harms of memes in closed environments, such as hate speech and cyber-bullying.
Approach: They propose a multimodal question-answering framework that solicits accurate responses to structured questions while providing coherent explanations.
Outcome: The proposed framework outperforms existing frameworks in predicting answer prediction accuracy and text generation lead over a baseline.
Are Vision-Language Models Safe in the Wild? A Meme-Based Benchmark Study (2025.emnlp-main)

Copied to clipboard

Challenge: Existing safety evaluations rely on artificial images to evaluate vision-language models . a recent study found that memes are more effective at bypassing safety measures than synthetic or typographic images.
Approach: They propose a benchmark pairing meme images with harmful and benign instructions . they assess multiple VLMs across single and multi-turn interactions .
Outcome: The proposed benchmark pairs real meme images with harmful and benign instructions.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations