Ambiguity-aware Multi-level Incongruity Fusion Network for Multi-Modal Sarcasm Detection (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for sarcasm detection focus on fusing text and image information to establish cross-modal correlations, overlooking the significance of original unimodal incongruity information. |
| Approach: | They propose a multi-modal incongruity learning module to capture inconcluity information simultaneously at the text-level, image-level and cross-modal-level. |
| Outcome: | The proposed model outperforms state-of-the-art methods on a publicly available dataset. |
Similar Papers
Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancement (2022.emnlp-main)
Copied to clipboard
| Challenge: | Sarcasm is a linguistic phenomenon indicating a discrepancy between literal meanings and implied intentions. |
| Approach: | They propose a hierarchical framework for sarcasm detection by exploring atomic-level congruity and composition-level convergence. |
| Outcome: | The proposed model outperforms existing methods on a public sarcasm detection dataset based on Twitter . |
Modeling Intra and Inter-modality Incongruity for Multi-Modal Sarcasm Detection (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for sarcasm detection ignore the incongruity character in sarcasm, which is often manifested between modalities or within modalités. |
| Approach: | They propose to capture inter-modality incongruity in a text-based model by using a self-attention mechanism and a co-attention model to model the contradiction within the text. |
| Outcome: | The proposed model achieves state-of-the-art on a public multi-modal sarcasm detection dataset. |
Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional Network (2022.acl-long)
Copied to clipboard
| Challenge: | Existing studies on multimodal sarcasm detection using textual and visual information have been limited to text-only approaches. |
| Approach: | They propose to construct a cross-modal graph for each multi-modal instance to explicitly draw the ironic relations between textual and visual modalities. |
| Outcome: | The proposed model achieves state-of-the-art in multi-modal sarcasm detection. |
Multi-Modal Sarcasm Detection in Twitter with Hierarchical Fusion Model (P19-1)
Copied to clipboard
| Challenge: | Existing methods to detect sarcasm focus on text, but they are insufficient for multi-modal messages. |
| Approach: | They propose a multi-modal hierarchical sarcasm detection model for tweets consisting of texts and images in Twitter. |
| Outcome: | The proposed model is able to detect sarcasm on twitter using three modalities . the proposed model can be used in customer service, opinion mining and harassment detection . |
Multi-View Incongruity Learning for Multimodal Sarcasm Detection (2025.coling-main)
Copied to clipboard
Diandian Guo, Cong Cao, Fangfang Yuan, Yanbing Liu, Guangjie Zeng, Xiaoyan Yu, Hao Peng, Philip S. Yu
| Challenge: | Existing methods for multimodal sarcasm detection rely on spurious correlations, demonstrating poor generalizability beyond training environments. |
| Approach: | They propose a method that integrates multimodal incongruities via contrastive learning for multimodal sarcasm detection by using three views to drive multi-view learning. |
| Outcome: | The proposed method outperforms existing methods on benchmark datasets and shows that it is more generalizable than existing methods. |
Incongruity-aware Tension Field Network for Multi-modal Sarcasm Detection (2025.acl-long)
Copied to clipboard
| Challenge: | Multi-modal sarcasm detection (MSD) identifies sarcasm and accurately understands users’ real attitudes from text-image pairs. |
| Approach: | They propose to use incongruity-aware tension field network to extract effective text-image feature pairs in fact and sentiment perspectives and construct a fact/sentiment tension field with discrepancy metrics to capture contextual tone and polarized inconcongruities. |
| Outcome: | The proposed method achieves state-of-the-art performance surpassing LLaVA1.5-7B with only 17.3M trainable parameters, demonstrating its optimal performance-efficiency in multi-modal sarcasm detection tasks. |
DGLF: A Dual Graph-based Learning Framework for Multi-modal Sarcasm Detection (2024.emnlp-main)
Copied to clipboard
Zhihong Zhu, Kefan Shen, Zhaorun Chen, Yunyan Zhang, Yuyan Chen, Xiaoqi Jiao, Zhongwei Wan, Shaorong Xie, Wei Liu, Xian Wu, Yefeng Zheng
| Challenge: | Existing methods for multimodal sarcasm detection neglect high-order relationships and underestimate high-frequency messages. |
| Approach: | They propose a Dual Graph-based Learning Framework to capture inter-modal inconsistencies . they propose combining a hypergraph and a vanilla graph to achieve enhanced propagation . |
| Outcome: | The proposed model outperforms existing state-of-the-art methods on two benchmark datasets. |
Breakthrough from Nuance and Inconsistency: Enhancing Multimodal Sarcasm Detection with Context-Aware Self-Attention Fusion and Word Weight Calculation. (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for sarcasm detection rely on feature concatenation to fuse different modalities or model inconsistencies among modalités. |
| Approach: | They propose to use Context-Aware Self-Attention Fusion to integrate local and momentary multimodal information into specific words to illustrate the inconsistencies between connotation and denotation. |
| Outcome: | The proposed method achieves an accuracy of 76.9 and an F1 score of 76.1 on the MUStARD dataset, surpassing the current state-of-the-art IWAN model by 1.7 and 1.6 respectively. |
Scale Is All You Need: Analyzing Modality Interaction and Speaker Intent Without Fine-Tuning (2026.eacl-srw)
Copied to clipboard
| Challenge: | Recent work on sarcasm and humor detection uses large multimodal Transformers, but they are computationally expensive and opaque. |
| Approach: | They propose a lightweight framework for multimodal sarcasm detection that combines frozen text, audio, and visual embeddings from pretrained encoders through compact fusion heads. |
| Outcome: | The proposed framework improves on the best unimodal baseline by combining text, audio, and visual embeddings from pretrained encoders with compact fusion heads. |
Towards Multi-modal Sarcasm Detection via Disentangled Multi-grained Multi-modal Distilling (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to sarcasm detection focus on textual and intra-modal incongruity . mainstream approaches process input of each modality in a holistic manner, resulting in redundant and unrefined information. |
| Approach: | They propose a framework for multi-modal sarcasm detection that disentangles modality representations into latent spaces and conducts multi-grained knowledge distilling. |
| Outcome: | The proposed framework overpowers existing methods on a common benchmark. |