Conversation Understanding using Relational Temporal Graph Neural Networks with Auxiliary Cross-Modality Interaction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Emotion recognition is a crucial task for human conversation understanding . multimodal data, e.g., language, voice, and facial expressions, add complexity to the task. |
| Approach: | They propose a relational temporal Graph Neural Network with Auxiliary Cross-Modality Interaction framework that captures conversation-level cross-modality interactions and utterance-level temporal dependencies with modality-specific manner for conversation understanding. |
| Outcome: | The proposed framework captures conversation-level cross-modality interactions and utterance-level temporal dependencies with the modality-specific manner for conversation understanding. |
Similar Papers
A Cross-Modality Context Fusion and Semantic Refinement Network for Emotion Recognition in Conversation (2023.acl-long)
Copied to clipboard
| Challenge: | Emotion recognition in conversation studies focus on textual modality, but they lack contextual information and focus on a limited number of modalities. |
| Approach: | They propose a cross-modal context fusion and semantic refinement network to explore multimodal interactions and a graph-based semantic refinements transformer to solve the limitation of insufficient semantic relationship information between utterances. |
| Outcome: | The proposed method is compared with other state-of-the-art methods on two public benchmark datasets and shows its potential for emotion recognition. |
Enhancing Emotion Recognition in Conversation via Multi-view Feature Alignment and Memorization (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Emotion recognition in conversation (ERC) is an advanced capability of conversational AI systems. |
| Approach: | They propose a semi-parametric paradigm for Emotion Recognition in conversation that uses supervised contrastive learning to align semantic-view and context-view features. |
| Outcome: | The proposed model achieves state-of-the-art on four widely used benchmarks. |
Conversational Memory Network for Emotion Recognition in Dyadic Dialogue Videos (N18-1)
Copied to clipboard
Devamanyu Hazarika, Soujanya Poria, Amir Zadeh, Erik Cambria, Louis-Philippe Morency, Roger Zimmermann
| Challenge: | Existing methods for recognizing emotions in conversations ignore inter-speaker dependency relations . dyadic conversations are a form of dialogue between two entities . |
| Approach: | They propose a deep neural framework which leverages contextual information from the conversation history to model past utterances of each speaker into memories. |
| Outcome: | The proposed framework improves by 3 4% over the state-of-the-art in recognizing emotions in dyadic conversational videos. |
DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation (D19-1)
Copied to clipboard
| Challenge: | Emotion recognition in conversation (ERC) has received much attention lately due to its potential widespread applications in diverse areas, such as health-care, education, and human resources. |
| Approach: | They propose a graph neural network-based approach to emotion recognition in conversation that leverages self and inter-speaker dependency of the interlocutors to model conversational context. |
| Outcome: | The proposed method outperforms the current state-of-the-art on a number of benchmark emotion classification datasets while minimizing context propagation issues. |
COGMEN: COntextualized GNN based Multimodal Emotion recognitioN (2022.naacl-main)
Copied to clipboard
| Challenge: | During a conversation, a person’s emotions are influenced by the other speaker’s utterances and their own emotional state over the utterrances. |
| Approach: | They propose a Graph Neural Network based Multi-modal Emotion recognitioN system that leverages local and global information in a conversation. |
| Outcome: | The proposed system gives state-of-the-art results on IEMOCAP and MOSEI datasets and detailed ablation experiments show the importance of modeling information at both levels. |
An Iterative Emotion Interaction Network for Emotion Recognition in Conversations (2020.coling-main)
Copied to clipboard
| Challenge: | Emotion recognition in conversations (ERC) is a task that aims to recognize the emotion of each utterance in conversations. |
| Approach: | They propose an iterative emotion interaction network which uses iterativly predicted emotion labels instead of gold emotion labels to explicitly model the emotion interaction. |
| Outcome: | The proposed method retains state-of-the-art performance on two datasets and achieves high accuracy. |
Directed Acyclic Graph Network for Conversational Emotion Recognition (2021.acl-long)
Copied to clipboard
| Challenge: | Empirical evidence shows that a good representation of conversation context significantly contributes to the model performance. |
| Approach: | They propose to encode query utterances with a directed acyclic graph to better model the intrinsic structure within a conversation. |
| Outcome: | The proposed model outperforms existing models on four ERC benchmarks with state-of-the-art models employed as baselines. |
Dynamic Graph Neural ODE Network for Multi-modal Emotion Recognition in Conversation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing graph-based multimodal emotion recognition methods fail to capture dynamic changes in emotions. |
| Approach: | They propose a Dynamic Graph Neural Ordinary Differential Equation Network (DGODE) which combines dynamic changes of emotions to capture temporal dependencies of speakers’ emotions. |
| Outcome: | The proposed model can capture the temporal dependencies caused by dynamic changes in emotions and can improve on two publicly available multimodal emotion recognition datasets. |
Relation-aware Graph Attention Networks with Relational Position Encodings for Emotion Recognition in Conversations (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent research on emotion recognition in conversations (ERC) does not take self-dependency or inter-speaker dependency into account. |
| Approach: | They propose a relational graph attention network (RGAT) model that takes speaker dependency and sequential information into account by encoding the relational Graph structure. |
| Outcome: | The proposed model outperforms the state-of-the-art on four ERC datasets. |
Multiple Knowledge-Enhanced Interactive Graph Network for Multimodal Conversational Emotion Recognition (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal Emotion Recognition in Conversations models struggle due to lack of Common Sense Knowledge (CSK). |
| Approach: | They propose a multimodal approach to integrate multiple knowledge into the edge representations by integrating textual and visual CSK. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two popular datasets. |