COMMA-DEER: COmmon-sense Aware Multimodal Multitask Approach for Detection of Emotion and Emotional Reasoning in Conversations (2022.coling-1)
Copied to clipboard
| Challenge: | Mental health is a critical component of the United Nations’ Sustainable Development Goals (SDGs), particularly Goal 3 which aims to provide “good health and well-being”. |
| Approach: | They propose a task of detecting emotional reasoning and accompanying emotions in conversations that is manually annotated at the utterance level. |
| Outcome: | The proposed model achieves 6% accuracy and 4.62% accuracy on the emotion detection task and 3.56% accuracy, and 3.31% F1 on the ER detection task, compared to the existing state-of-the-art model. |
Similar Papers
Multiple Knowledge-Enhanced Interactive Graph Network for Multimodal Conversational Emotion Recognition (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal Emotion Recognition in Conversations models struggle due to lack of Common Sense Knowledge (CSK). |
| Approach: | They propose a multimodal approach to integrate multiple knowledge into the edge representations by integrating textual and visual CSK. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two popular datasets. |
MultiEMO: An Attention-Based Correlation-Aware Multimodal Fusion Framework for Emotion Recognition in Conversations (2023.acl-long)
Copied to clipboard
| Challenge: | Emotion Recognition in Conversations (ERC) is an increasingly popular task in the field of Natural Language Processing. |
| Approach: | They propose a framework that captures cross-modal mapping relationships across modalities . they propose 'multiemotion-aware' framework that integrates multimodal cues into the model . |
| Outcome: | The proposed framework outperforms state-of-the-art models in all emotion categories on two benchmark datasets. |
Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospects (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal Emotion Recognition in Conversations (MERC) is a new way to enhance human-computer interaction. |
| Approach: | This survey offers a systematic overview of Multimodal Emotion Recognition in Conversations . it examines motivations, core tasks, representative methods, and evaluation strategies . |
| Outcome: | The survey examines the effectiveness of MERC and its evaluation strategies. |
Multi-Condition Guided Diffusion Network for Multimodal Emotion Recognition in Conversation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Current research emphasizes contextual factors, the speaker’s influence, and extracting complementary information across different modalities. |
| Approach: | They propose a diffusion-based approach to address the challenges posed by redundant information and redundant information at the semantic level while robustly capturing shared semantics. |
| Outcome: | The proposed model outperforms existing state-of-the-art models on two multimodal datasets and is generalizable and effective. |
A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations (2023.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown the importance of visual information in multi-party conversations due to the complexity of visual scenes. |
| Approach: | They propose a framework to extract face sequences as visual features from a real speaker's utterance and a pipeline method to extract the face sequence. |
| Outcome: | The proposed framework extracts face sequences of the real speaker of each utterance and improves emotion prediction on the MELD dataset. |
UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies study sentiment and emotion separately and do not fully exploit the complementary knowledge behind the two. |
| Approach: | They propose a multimodal sentiment knowledge-sharing framework that unifies MSA and ERC tasks from features, labels, and models. |
| Outcome: | The proposed framework achieves consistent improvements on four public benchmark datasets on MOSI, MOSEI, MELD, and IEMOCAP. |
JX4MEI: Multimodal Semantically-Enhanced LLM for Joint Multimodal Emotion-Intent Explanation and Classification (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing multimodal emotion and intent recognition tasks focus on classification, not rationale and intrinsic connections between these states. |
| Approach: | They propose a task that requires models to jointly predict emotion and intent while generating natural language explanations for why they co-occur. |
| Outcome: | The proposed model outperforms baseline models in prediction and explanation generation. |
Self-adaptive Context and Modal-interaction Modeling For Multimodal Emotion Recognition (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to predict emotion label for a given utterance lack modeling of diverse dependency ranges and inconsistent treatment of contribution for various modalities. |
| Approach: | They propose a multimodal emotion recognition in conversation task that uses context and multiple modalities to predict emotion label for a given utterance. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on three multimodal datasets. |
Standardizing Distress Analysis: Emotion-Driven Distress Identification and Cause Extraction (DICE) in Multimodal Online Posts (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for identifying hate speech have been limited to analyzing textual content. |
| Approach: | They propose a method for distress identification and cause extraction from social media posts using emotional information. |
| Outcome: | The proposed method improves F1 and ROS scores by 1.95% and 3% relative to the best-performing baseline. |
A Sentiment and Emotion Aware Multimodal Multiparty Humor Recognition in Multilingual Conversational Setting (2022.coling-1)
Copied to clipboard
| Challenge: | Humor is an essential aspect of daily conversation, and people try to provoke humor in their talks. |
| Approach: | They propose a multitask framework that annotates Hindi utterances with sentiment and emotion classes. |
| Outcome: | The proposed framework improves on the recently released Hindi Humor dataset . it takes sentiment and emotion into account to understand humor . |