Context-aware Interactive Attention for Multi-modal Sentiment and Emotion Analysis (D19-1)
Copied to clipboard
| Challenge: | Multi-modal analysis is a field emerging in the fields of natural language processing, computer vision and speech processing . multimodal analysis uses a variety of information from multiple sources to build efficient systems . acoustic and visual information can provide better information for classification decisions . |
| Approach: | They propose a recurrent neural network based approach for multi-modal sentiment and emotion analysis . they employ a context-aware attention module to exploit the correspondence among neighboring utterances . |
| Outcome: | The proposed model learns inter-modal interaction among participating modalities through auto-encoder mechanism . it is compared with existing state-of-the-art models on five standard multi-modal affect analysis datasets . |
Similar Papers
Contextual Inter-modal Attention for Multi-modal Sentiment Analysis (D18-1)
Copied to clipboard
Deepanway Ghosal, Md Shad Akhtar, Dushyant Chauhan, Soujanya Poria, Asif Ekbal, Pushpak Bhattacharyya
| Challenge: | Existing methods for multi-modal sentiment analysis are limited due to the use of text, visual and acoustic inputs. |
| Approach: | They propose a recurrent neural network based multi-modal attention framework that leverages contextual information for utterance-level sentiment prediction. |
| Outcome: | The proposed framework performs better on two multi-modal sentiment analysis benchmark datasets with accuracies of 82.31% and 79.80% for the MOSI and MOSEI datasets. |
Multi-task Learning for Multi-modal Emotion Recognition and Sentiment Analysis (N19-1)
Copied to clipboard
Md Shad Akhtar, Dushyant Chauhan, Deepanway Ghosal, Soujanya Poria, Asif Ekbal, Pushpak Bhattacharyya
| Challenge: | Existing frameworks for sentiment and emotion analysis are not efficient for inter-task learning. |
| Approach: | They propose a multi-task learning framework that performs sentiment and emotion analysis together. |
| Outcome: | The proposed framework improves on a CMU-MOSEI dataset for sentiment and emotion analysis. |
Attention and Lexicon Regularized LSTM for Aspect-based Sentiment Analysis (P19-2)
Copied to clipboard
| Challenge: | End-to-end deep learning systems lack flexibility as one cannot adjust the network to fix an obvious problem. |
| Approach: | They propose a way to leverage lexicon information to make the model more flexible . they also explore the effect of regularizing attention vectors to allow the network to have a broader "focus" |
| Outcome: | The proposed approach leverages lexicon information to make it more flexible and robust. |
ECERC: Evidence-Cause Attention Network for Multi-Modal Emotion Recognition in Conversation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for multi-modal emotion recognition in isolated utterances do not capture emotional causes, including emotional contagion, influences from others, and self-referenced or externally introduced events. |
| Approach: | They propose a multi-modal conversational emotion recognition system that integrates emotional evidence with contextual causes through five stages. |
| Outcome: | The proposed method achieves competitive performance on two widely used benchmark datasets, IEMOCAP and MELD. |
Progressive Self-Supervised Attention Learning for Aspect-Level Sentiment Analysis (P19-1)
Copied to clipboard
| Challenge: | Experimental results show that our proposed approach yields better attention mechanisms . dominant ASC models are mostly discriminative classifiers based on manual feature engineering . |
| Approach: | They propose a self-supervised approach to aspect-level sentiment classification that mines useful attention supervision information from a training corpus to refine attention mechanisms. |
| Outcome: | The proposed approach yields better attention mechanisms on multiple datasets. |
Deep Context- and Relation-Aware Learning for Aspect-based Sentiment Analysis (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods for aspect-based sentiment analysis (ABSA) consider relationships implicitly among subtasks at the word level. |
| Approach: | They propose a deep contextualized relation-aware network that allows interactive relations among subtasks . they propose self-supervised strategies that deal with multiple aspects . |
| Outcome: | The proposed method outperforms state-of-the-art methods on three widely used benchmarks. |
Modeling Inter-Aspect Dependencies for Aspect-Based Sentiment Analysis (N18-2)
Copied to clipboard
Devamanyu Hazarika, Soujanya Poria, Prateek Vij, Gangeshwar Krishnamurthy, Erik Cambria, Roger Zimmermann
| Challenge: | Present neural-based models exploit aspect and its contextual information in the sentence but ignore inter-aspect dependencies. |
| Approach: | They propose to combine aspect-based sentiment analysis with temporal dependency processing to incorporate this pattern into a sentence. |
| Outcome: | The proposed approach is based on the SemEval 2014 dataset and shows that it is effective for predicting sentiments of aspects in sentences with multiple aspects. |
Multimodal Affective Analysis Using Hierarchical Attention Strategy with Word-Level Alignment (P18-1)
Copied to clipboard
| Challenge: | Existing approaches to classify human affect and subjective information from multiple data sources are limited by the lack of high-level feature associations. |
| Approach: | They propose a hierarchical multimodal architecture with attention and word-level fusion to classify utterance-level sentiment and emotion from text and audio data. |
| Outcome: | The proposed model outperforms state-of-the-art approaches on published datasets and visualizes and interprets synchronized attention over modalities. |
Self-adaptive Context and Modal-interaction Modeling For Multimodal Emotion Recognition (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to predict emotion label for a given utterance lack modeling of diverse dependency ranges and inconsistent treatment of contribution for various modalities. |
| Approach: | They propose a multimodal emotion recognition in conversation task that uses context and multiple modalities to predict emotion label for a given utterance. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on three multimodal datasets. |
Multimodal Multi-loss Fusion Network for Sentiment Analysis (2024.naacl-long)
Copied to clipboard
| Challenge: | This paper examines the optimal selection and fusion of feature encoders across multiple modalities and combines them in one neural network to improve sentiment detection. |
| Approach: | They propose to combine feature encoders across multiple modalities into one neural network to improve sentiment detection. |
| Outcome: | The proposed model achieves state-of-the-art performance for three datasets . it also shows that integrating context significantly improves model performance. |