MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection System (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks for multi-modal sarcasm detection have some shortcomings . a new framework can leverage multi-grained cues from multiple perspectives for multimodal detection . |
| Approach: | They propose a correction dataset that removes spurious cues and re-annotates the unreasonable samples. |
| Outcome: | The proposed framework outperforms the existing benchmarks in multi-modal sarcasm detection. |
Similar Papers
Multi-View Incongruity Learning for Multimodal Sarcasm Detection (2025.coling-main)
Copied to clipboard
Diandian Guo, Cong Cao, Fangfang Yuan, Yanbing Liu, Guangjie Zeng, Xiaoyan Yu, Hao Peng, Philip S. Yu
| Challenge: | Existing methods for multimodal sarcasm detection rely on spurious correlations, demonstrating poor generalizability beyond training environments. |
| Approach: | They propose a method that integrates multimodal incongruities via contrastive learning for multimodal sarcasm detection by using three views to drive multi-view learning. |
| Outcome: | The proposed method outperforms existing methods on benchmark datasets and shows that it is more generalizable than existing methods. |
Leveraging Generative Large Language Models with Visual Instruction and Demonstration Retrieval for Multimodal Sarcasm Detection (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for multimodal sarcasm detection do not fully utilize cross-modal features, limiting their performance on in-domain datasets. |
| Approach: | They propose a multimodal sarcasm detection model with a designed instruction template and a demonstration retrieval module. |
| Outcome: | The proposed model outperforms existing methods on in-domain datasets and achieves state-of-the-art performance. |
Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper) (P19-1)
Copied to clipboard
Santiago Castro, Devamanyu Hazarika, Verónica Pérez-Rosas, Roger Zimmermann, Rada Mihalcea, Soujanya Poria
| Challenge: | sarcasm is often expressed through multiple verbal and non-verbal cues, such as a change of tone, overemphasis, drawn-out syllables, or a straight looking face. |
| Approach: | They propose to use multimodal cues to improve sarcasm detection using audiovisual utterances annotated with sarcasm labels to improve the accuracy. |
| Outcome: | The proposed dataset reduces the error rate of sarcasm detection by 12.9% . it is based on audiovisual utterances annotated with sarcasm labels . |
Towards Multi-modal Sarcasm Detection via Disentangled Multi-grained Multi-modal Distilling (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to sarcasm detection focus on textual and intra-modal incongruity . mainstream approaches process input of each modality in a holistic manner, resulting in redundant and unrefined information. |
| Approach: | They propose a framework for multi-modal sarcasm detection that disentangles modality representations into latent spaces and conducts multi-grained knowledge distilling. |
| Outcome: | The proposed framework overpowers existing methods on a common benchmark. |
Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancement (2022.emnlp-main)
Copied to clipboard
| Challenge: | Sarcasm is a linguistic phenomenon indicating a discrepancy between literal meanings and implied intentions. |
| Approach: | They propose a hierarchical framework for sarcasm detection by exploring atomic-level congruity and composition-level convergence. |
| Outcome: | The proposed model outperforms existing methods on a public sarcasm detection dataset based on Twitter . |
SarcNet: A Multilingual Multimodal Sarcasm Detection Dataset (2024.lrec-main)
Copied to clipboard
| Challenge: | Sarcasm is an implicit form of sarcasm, involving an intended meaning that contradicts the literal expression . human use conflict between factual information and a statement as cues to detect sarcasm . sarkasmatic analysis is challenging due to its implicit nature . |
| Approach: | They propose a multimodal sarcasm detection dataset that uses multiple modalities to detect sarcasm. |
| Outcome: | The proposed model improves on previous models based on a single label . human sarcasm cannot be detected using a unified label across multiple modalities . |
CofiPara: A Coarse-to-fine Paradigm for Multimodal Sarcasm Target Identification with Large Multimodal Models (2024.acl-long)
Copied to clipboard
| Challenge: | Current methods for multimodal sarcasm target identification focus on superficial indicators in an end-to-end manner, overlooking the nuanced understanding of multimodal content. |
| Approach: | They propose a multimodal sarcasm target identification framework with a coarse-to-fine paradigm by augmenting sarcasm explainability with reasoning and pre-training knowledge. |
| Outcome: | The proposed framework outperforms state-of-the-art methods and exhibits explainability in deciphering sarcasm as well. |
Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional Network (2022.acl-long)
Copied to clipboard
| Challenge: | Existing studies on multimodal sarcasm detection using textual and visual information have been limited to text-only approaches. |
| Approach: | They propose to construct a cross-modal graph for each multi-modal instance to explicitly draw the ironic relations between textual and visual modalities. |
| Outcome: | The proposed model achieves state-of-the-art in multi-modal sarcasm detection. |
Ambiguity-aware Multi-level Incongruity Fusion Network for Multi-Modal Sarcasm Detection (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for sarcasm detection focus on fusing text and image information to establish cross-modal correlations, overlooking the significance of original unimodal incongruity information. |
| Approach: | They propose a multi-modal incongruity learning module to capture inconcluity information simultaneously at the text-level, image-level and cross-modal-level. |
| Outcome: | The proposed model outperforms state-of-the-art methods on a publicly available dataset. |
A Multimodal Corpus for Emotion Recognition in Sarcasm (2022.lrec-1)
Copied to clipboard
| Challenge: | sarcasm and emotion are often used in conversational systems to generate the right response. |
| Approach: | They use a sarcastic expression dataset pre-annotated with 9 emotions to detect emotion . they identify and correct 343 incorrect emotion labels and label each sarkastic utterance with one of four sarcasm types. |
| Outcome: | The proposed model outperforms state-of-the-art sarcasm detection methods by using a multimodal sarcastic detection dataset. |