MuCDN: Mutual Conversational Detachment Network for Emotion Recognition in Multi-Party Conversations (2022.coling-1)
Copied to clipboard
| Challenge: | Emotion recognition in multi-party conversations is a challenging task that predicts the emotion for each utterance. |
| Approach: | They propose to separate conversations into detached threads to capture emotional clues in conversational context . they propose to use mutual detachment networks to perform context and speaker-specific modeling within detached thread. |
| Outcome: | The proposed model outperforms baseline models on two datasets. |
Similar Papers
DialogueCRN: Contextual Reasoning Networks for Emotion Recognition in Conversations (2021.acl-long)
Copied to clipboard
| Challenge: | Recent studies on ERC lack the ability to extract and integrate emotional clues from the conversational context. |
| Approach: | They propose a new model that uses multi-turn reasoning modules to extract and integrate emotional clues from conversational context. |
| Outcome: | The proposed model outperforms existing models on three public benchmark datasets and is highly effective and superior to existing models. |
Conversational Memory Network for Emotion Recognition in Dyadic Dialogue Videos (N18-1)
Copied to clipboard
Devamanyu Hazarika, Soujanya Poria, Amir Zadeh, Erik Cambria, Louis-Philippe Morency, Roger Zimmermann
| Challenge: | Existing methods for recognizing emotions in conversations ignore inter-speaker dependency relations . dyadic conversations are a form of dialogue between two entities . |
| Approach: | They propose a deep neural framework which leverages contextual information from the conversation history to model past utterances of each speaker into memories. |
| Outcome: | The proposed framework improves by 3 4% over the state-of-the-art in recognizing emotions in dyadic conversational videos. |
Multi-Condition Guided Diffusion Network for Multimodal Emotion Recognition in Conversation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Current research emphasizes contextual factors, the speaker’s influence, and extracting complementary information across different modalities. |
| Approach: | They propose a diffusion-based approach to address the challenges posed by redundant information and redundant information at the semantic level while robustly capturing shared semantics. |
| Outcome: | The proposed model outperforms existing state-of-the-art models on two multimodal datasets and is generalizable and effective. |
MMDAG: Multimodal Directed Acyclic Graph Network for Emotion Recognition in Conversation (2022.lrec-1)
Copied to clipboard
| Challenge: | Emotion recognition in conversation is important for an empathetic dialogue system to understand the user’s emotion and then generate appropriate emotional responses. |
| Approach: | They propose to use multimodal directed acyclic graphs to integrate multimodal information and contextual information into a DAG architecture to exploit multimodal contexts. |
| Outcome: | Comparative studies on IEMOCAP and MELD show that the proposed model outperforms state-of-the-art models. |
MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversation (2021.acl-long)
Copied to clipboard
| Challenge: | Emotion recognition in conversation is a crucial component in affective dialogue systems, which helps the system understand users’ emotions and generate empathetic responses. |
| Approach: | They propose a multimodal fused graph convolutional network model which leverages multimodal dependencies and speaker information to model inter-speaker and intra-speech dependency. |
| Outcome: | The proposed model outperforms other SOTA methods on two public benchmark datasets, IEMOCAP and MELD. |
Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospects (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal Emotion Recognition in Conversations (MERC) is a new way to enhance human-computer interaction. |
| Approach: | This survey offers a systematic overview of Multimodal Emotion Recognition in Conversations . it examines motivations, core tasks, representative methods, and evaluation strategies . |
| Outcome: | The survey examines the effectiveness of MERC and its evaluation strategies. |
ICON: Interactive Conversational Memory Network for Multimodal Emotion Detection (D18-1)
Copied to clipboard
| Challenge: | Existing studies do not explicitly consider inter-personal influences that thrive in the emotional dynamics of dialogues. |
| Approach: | They propose a multimodal emotion detection framework that extracts multimodal features from conversational videos and hierarchically models the self- and inter-speaker emotional influences into global memories. |
| Outcome: | The proposed model outperforms state-of-the-art networks on multiple classification and regression tasks in two benchmark datasets. |
Emotion Recognition in Multi-Speaker Conversations through Speaker Identification, Knowledge Distillation, and Hierarchical Fusion (2026.findings-eacl)
Copied to clipboard
| Challenge: | Emotion recognition in multi-speaker conversations faces significant challenges due to speaker ambiguity and severe class imbalance. |
| Approach: | They propose a speaker identification module that leverages audio-visual synchronization to accurately identify the active speaker and hierarchical attention fusion with composite loss functions to handle class imbalance. |
| Outcome: | The proposed framework achieves 67.75% and 72.44% weighted F1 scores on MELD and IEMOCAP datasets, with notable improvements on minority emotion classes. |
EmotionLines: An Emotion Corpus of Multi-Party Conversations (L18-1)
Copied to clipboard
| Challenge: | Emotion is a critical characteristic to distinguish people from machines. |
| Approach: | They propose a dataset with emotions labeling on all utterances in each dialogue . they use Friends TV scripts and Facebook messenger dialogues to collect the data . |
| Outcome: | The proposed dataset is the first with emotions labeling on all utterances in each dialogue based on their textual content. |
COGMEN: COntextualized GNN based Multimodal Emotion recognitioN (2022.naacl-main)
Copied to clipboard
| Challenge: | During a conversation, a person’s emotions are influenced by the other speaker’s utterances and their own emotional state over the utterrances. |
| Approach: | They propose a Graph Neural Network based Multi-modal Emotion recognitioN system that leverages local and global information in a conversation. |
| Outcome: | The proposed system gives state-of-the-art results on IEMOCAP and MOSEI datasets and detailed ablation experiments show the importance of modeling information at both levels. |