Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing graph-based multimodal emotion recognition methods fail to capture dynamic changes in emotions. |
| Approach: | They propose a Dynamic Graph Neural Ordinary Differential Equation Network (DGODE) which combines dynamic changes of emotions to capture temporal dependencies of speakers’ emotions. |
| Outcome: | The proposed model can capture the temporal dependencies caused by dynamic changes in emotions and can improve on two publicly available multimodal emotion recognition datasets. |
Similar Papers
MMGCN: Multimodal Fusion via Deep Graph Convolution Network for Emotion Recognition in Conversation (2021.acl-long)
Copied to clipboard
| Challenge: | Emotion recognition in conversation is a crucial component in affective dialogue systems, which helps the system understand users’ emotions and generate empathetic responses. |
| Approach: | They propose a multimodal fused graph convolutional network model which leverages multimodal dependencies and speaker information to model inter-speaker and intra-speech dependency. |
| Outcome: | The proposed model outperforms other SOTA methods on two public benchmark datasets, IEMOCAP and MELD. |
Multiple Knowledge-Enhanced Interactive Graph Network for Multimodal Conversational Emotion Recognition (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal Emotion Recognition in Conversations models struggle due to lack of Common Sense Knowledge (CSK). |
| Approach: | They propose a multimodal approach to integrate multiple knowledge into the edge representations by integrating textual and visual CSK. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two popular datasets. |
DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation (D19-1)
Copied to clipboard
| Challenge: | Emotion recognition in conversation (ERC) has received much attention lately due to its potential widespread applications in diverse areas, such as health-care, education, and human resources. |
| Approach: | They propose a graph neural network-based approach to emotion recognition in conversation that leverages self and inter-speaker dependency of the interlocutors to model conversational context. |
| Outcome: | The proposed method outperforms the current state-of-the-art on a number of benchmark emotion classification datasets while minimizing context propagation issues. |
COGMEN: COntextualized GNN based Multimodal Emotion recognitioN (2022.naacl-main)
Copied to clipboard
| Challenge: | During a conversation, a person’s emotions are influenced by the other speaker’s utterances and their own emotional state over the utterrances. |
| Approach: | They propose a Graph Neural Network based Multi-modal Emotion recognitioN system that leverages local and global information in a conversation. |
| Outcome: | The proposed system gives state-of-the-art results on IEMOCAP and MOSEI datasets and detailed ablation experiments show the importance of modeling information at both levels. |
MMDAG: Multimodal Directed Acyclic Graph Network for Emotion Recognition in Conversation (2022.lrec-1)
Copied to clipboard
| Challenge: | Emotion recognition in conversation is important for an empathetic dialogue system to understand the user’s emotion and then generate appropriate emotional responses. |
| Approach: | They propose to use multimodal directed acyclic graphs to integrate multimodal information and contextual information into a DAG architecture to exploit multimodal contexts. |
| Outcome: | Comparative studies on IEMOCAP and MELD show that the proposed model outperforms state-of-the-art models. |
Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospects (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal Emotion Recognition in Conversations (MERC) is a new way to enhance human-computer interaction. |
| Approach: | This survey offers a systematic overview of Multimodal Emotion Recognition in Conversations . it examines motivations, core tasks, representative methods, and evaluation strategies . |
| Outcome: | The survey examines the effectiveness of MERC and its evaluation strategies. |
Multi-Condition Guided Diffusion Network for Multimodal Emotion Recognition in Conversation (2025.findings-naacl)
Copied to clipboard
| Challenge: | Current research emphasizes contextual factors, the speaker’s influence, and extracting complementary information across different modalities. |
| Approach: | They propose a diffusion-based approach to address the challenges posed by redundant information and redundant information at the semantic level while robustly capturing shared semantics. |
| Outcome: | The proposed model outperforms existing state-of-the-art models on two multimodal datasets and is generalizable and effective. |
Conversation Understanding using Relational Temporal Graph Neural Networks with Auxiliary Cross-Modality Interaction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Emotion recognition is a crucial task for human conversation understanding . multimodal data, e.g., language, voice, and facial expressions, add complexity to the task. |
| Approach: | They propose a relational temporal Graph Neural Network with Auxiliary Cross-Modality Interaction framework that captures conversation-level cross-modality interactions and utterance-level temporal dependencies with modality-specific manner for conversation understanding. |
| Outcome: | The proposed framework captures conversation-level cross-modality interactions and utterance-level temporal dependencies with the modality-specific manner for conversation understanding. |
Static and Dynamic Speaker Modeling based on Graph Neural Network for Emotion Recognition in Conversation (2022.naacl-srw)
Copied to clipboard
| Challenge: | Hence, speaker modeling is important for the task of emotion recognition in conversation (ERC). |
| Approach: | They propose a graph-based ERC model which considers conversational context and speaker personality. |
| Outcome: | The proposed model outperforms baseline and other graph-based methods on a benchmark dataset. |
S+PAGE: A Speaker and Position-Aware Graph Neural Network Model for Emotion Recognition in Conversation (2022.aacl-main)
Copied to clipboard
| Challenge: | Emotion recognition in conversation (ERC) is a task arousing increasing interest in many fields. |
| Approach: | They propose a novel GNN-based ERC model that captures speaker and position information. |
| Outcome: | The proposed model captures speaker and position-aware conversation structure information. |