MemeReaCon: Probing Contextual Meme Understanding in Large Vision-Language Models (2025.emnlp-main)
Copied to clipboard
Zhengyi Zhao, Shubo Zhang, Yuxi Zhang, Yanxi Zhao, Yifan Zhang, Zezhong Wang, Huimin Wang, Yutian Zhao, Bin Liang, Yefeng Zheng, Binyang Li, Kam-Fai Wong, Xian Wu
| Challenge: | Current approaches focus on isolated meme analysis, either for harmful content detection or standalone interpretation, overlooking a fundamental challenge: the same meme can express different intents depending on its conversational context. |
| Approach: | They propose a benchmark to evaluate how large vision language models understand memes in their original context. |
| Outcome: | The proposed benchmark evaluates how large vision language models understand meme intent in their original context. |
Similar Papers
MEMEX: Detecting Explanatory Evidence for Memes via Knowledge-Enriched Contextualization (2023.acl-long)
Copied to clipboard
| Challenge: | Besides digital archiving of memes and their metadata, there is no efficient way to deduce a meme’s context dynamically. |
| Approach: | They propose a task to mine the context that succinctly explains the background of a meme and a related document to capture cross-modal semantic dependencies between the meme and the context. |
| Outcome: | The proposed dataset outperforms existing systems and shows that it can capture cross-modal semantic dependencies between the meme and the context. |
Computational Meme Understanding: A Survey (2024.emnlp-main)
Copied to clipboard
| Challenge: | Computational Meme Understanding (CMU) is a collection of tasks involving the automated comprehension of memes. |
| Approach: | They propose a comprehensive taxonomy for memes along three dimensions – forms, functions, and topics and introduce three key tasks for Computational Meme Understanding, namely classification, interpretation, and explanation. |
| Outcome: | The proposed model is based on a taxonomy of memes along three dimensions and is compared to existing models and datasets. |
MemeQA: Holistic Evaluation for Meme Understanding (2025.acl-long)
Copied to clipboard
Khoi P. N. Nguyen, Terrence Li, Derek Lou Zhou, Gabriel Xiong, Pranav Balu, Nandhan Alahari, Alan Huang, Tanush Chauhan, Harshavardhan Bala, Emre Guzelordu, Affan Kashfi, Aaron Xu, Suyesh Shrestha, Megan Vu, Jerry Wang, Vincent Ng
| Challenge: | Existing benchmarks for meme understanding only concern narrow aspects of meme semantics. |
| Approach: | They propose to use multiple-choice questions to evaluate meme comprehension . they use a dataset of over 9,000 multiple-question questions to assess meme comprehension. |
| Outcome: | The proposed model outperforms existing models on meme comprehension . the model makes many errors on memes where proper understanding requires going beyond sentiment . |
MemeIntel: Explainable Detection of Propagandistic and Hateful Memes (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for label detection and explanation generation have been limited in understanding complex issues . identifying propaganda and hate in memes is essential for combating misinformation and minimizing harm . |
| Approach: | They propose an explanation-enhanced dataset for propaganda memes in Arabic and hateful memes on English to solve these tasks. |
| Outcome: | The proposed model outperforms the current state-of-the-art in label detection and explanation generation. |
MemeCap: A Dataset for Captioning and Interpreting Memes (2023.emnlp-main)
Copied to clipboard
| Challenge: | a new dataset aims to understand meme captioning tasks using visual metaphors . vision and language models are proving to be effective in image captioning and visual question answering tasks . |
| Approach: | They present a dataset that contains 6.3K memes and 6.3k meme captions . they show that vision and language models still struggle with visual metaphors despite their advanced capabilities . |
| Outcome: | The proposed dataset contains 6.3K memes along with the title of the post containing the meme, meme captions, literal image caption, and visual metaphors. |
Meme-ingful Analysis: Enhanced Understanding of Cyberbullying in Memes Through Multimodal Explanations (2024.eacl-long)
Copied to clipboard
| Challenge: | Recent laws like “right to explanations” have spurred research in developing interpretable models . a recent study has shown that multimodal explanations improve performance in generating textual justifications . |
| Approach: | They propose to use visual and textual modalities to explain why a given meme is cyberbullying . they use a Contrastive Language-Image Pretraining approach to generate textual justifications . |
| Outcome: | The proposed model improves performance in visual and textual explanations and identifies the visual evidence supporting a decision. |
MemeInterpret: Towards an All-in-One Dataset for Meme Understanding (2025.findings-emnlp)
Copied to clipboard
Jeongsik Park, Khoi P. N. Nguyen, Jihyung Park, Minseok Kim, Jaeheon Lee, Jae Won Choi, Kalyani Ganta, Phalgun Ashrit Kasu, Rohan Sarakinti, Sanjana Vipperla, Sai Sathanapalli, Nishan Vaghani, Vincent Ng
| Challenge: | Existing research has not explored meme captioning's decomposition into subtasks or its connections to other CMU tasks. |
| Approach: | a new meme corpus is built upon the Facebook Hateful Memes dataset . it contains meme captions, corresponding surface messages and relevant background knowledge . |
| Outcome: | a new corpus of meme captions and surface messages unifies three major categories of CMU tasks for the first time. |
Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for harmful meme detection ignore in-depth cognition of meme text and image . authors propose a framework for learning reasonable thoughts from LLMs for better multimodal fusion . |
| Approach: | They propose to use large language models to learn reasonable thoughts from LLMs for better multimodal fusion and lightweight fine-tuning. |
| Outcome: | The proposed approach achieves superior performance than state-of-the-art methods on the harmful meme detection task. |
MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencing (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have focused on harms of memes in closed environments, such as hate speech and cyber-bullying. |
| Approach: | They propose a multimodal question-answering framework that solicits accurate responses to structured questions while providing coherent explanations. |
| Outcome: | The proposed framework outperforms existing frameworks in predicting answer prediction accuracy and text generation lead over a baseline. |
Are Vision-Language Models Safe in the Wild? A Meme-Based Benchmark Study (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing safety evaluations rely on artificial images to evaluate vision-language models . a recent study found that memes are more effective at bypassing safety measures than synthetic or typographic images. |
| Approach: | They propose a benchmark pairing meme images with harmful and benign instructions . they assess multiple VLMs across single and multi-turn interactions . |
| Outcome: | The proposed benchmark pairs real meme images with harmful and benign instructions. |