Multi-task Learning for Multi-modal Emotion Recognition and Sentiment Analysis (N19-1)
Copied to clipboard
Md Shad Akhtar, Dushyant Chauhan, Deepanway Ghosal, Soujanya Poria, Asif Ekbal, Pushpak Bhattacharyya
| Challenge: | Existing frameworks for sentiment and emotion analysis are not efficient for inter-task learning. |
| Approach: | They propose a multi-task learning framework that performs sentiment and emotion analysis together. |
| Outcome: | The proposed framework improves on a CMU-MOSEI dataset for sentiment and emotion analysis. |
Similar Papers
Sentiment and Emotion help Sarcasm? A Multi-task Learning Framework for Multi-Modal Sarcasm, Sentiment and Emotion Analysis (2020.acl-main)
Copied to clipboard
| Challenge: | Existing systems for sarcasm detection are limited by the use of sarcasm . sarasm is often used to convey thinly veiled disapproval humorously. |
| Approach: | They propose a multi-task deep learning framework to solve sarcasm problems simultaneously . they manually annotate a sarcsm dataset with sentiment and emotion classes . |
| Outcome: | The proposed framework is able to solve sarcasm, sentiment and emotion problems in a multi-modal conversational scenario. |
Contextual Inter-modal Attention for Multi-modal Sentiment Analysis (D18-1)
Copied to clipboard
Deepanway Ghosal, Md Shad Akhtar, Dushyant Chauhan, Soujanya Poria, Asif Ekbal, Pushpak Bhattacharyya
| Challenge: | Existing methods for multi-modal sentiment analysis are limited due to the use of text, visual and acoustic inputs. |
| Approach: | They propose a recurrent neural network based multi-modal attention framework that leverages contextual information for utterance-level sentiment prediction. |
| Outcome: | The proposed framework performs better on two multi-modal sentiment analysis benchmark datasets with accuracies of 82.31% and 79.80% for the MOSI and MOSEI datasets. |
An Interactive Multi-Task Learning Network for End-to-End Aspect-Based Sentiment Analysis (P19-1)
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis produces a list of aspect terms and their corresponding sentiments for a sentence. |
| Approach: | They propose an interactive multi-task learning network which can learn multiple tasks simultaneously . they use a shared set of latent variables to iteratively pass information between tasks . |
| Outcome: | The proposed method outperforms existing methods on three benchmark datasets. |
Emotion Detection and Classification in a Multigenre Corpus with Joint Multi-Task Deep Learning (C18-1)
Copied to clipboard
| Challenge: | Sentence-level emotion detection is a challenging task due to subjectivity of emotion. |
| Approach: | They propose a model to address genre robustness in a multi-task learning problem . they use a genre-based corpus to train a neural net model with different genres . |
| Outcome: | The proposed model improves the results across different genres compared to a single model trained on a genre. |
Context-aware Interactive Attention for Multi-modal Sentiment and Emotion Analysis (D19-1)
Copied to clipboard
| Challenge: | Multi-modal analysis is a field emerging in the fields of natural language processing, computer vision and speech processing . multimodal analysis uses a variety of information from multiple sources to build efficient systems . acoustic and visual information can provide better information for classification decisions . |
| Approach: | They propose a recurrent neural network based approach for multi-modal sentiment and emotion analysis . they employ a context-aware attention module to exploit the correspondence among neighboring utterances . |
| Outcome: | The proposed model learns inter-modal interaction among participating modalities through auto-encoder mechanism . it is compared with existing state-of-the-art models on five standard multi-modal affect analysis datasets . |
Towards Sentiment and Emotion aided Multi-modal Speech Act Classification in Twitter (2021.naacl-main)
Copied to clipboard
| Challenge: | Speech Act Classification determining the communicative intent of an utterance has been investigated widely over the years as a standalone task. |
| Approach: | They propose a multi-modal, emotion-TA dataset called EmoTA from open-source Twitter dataset and a Dyadic Attention Mechanism framework that integrates intra-modal and inter-modal attention to fuse multiple modalities. |
| Outcome: | The proposed framework boosts the performance of the primary task, i.e., TA classification (TAC), by benefitting from the two secondary tasks, namely, Sentiment and Emotion Analysis compared to its uni-modal and single task TAC variants. |
Word Emotion Induction for Multiple Languages as a Deep Multi-Task Learning Problem (N18-1)
Copied to clipboard
| Challenge: | a recent shift towards expressive emotion representation models has hampered deep learning in sentiment analysis. |
| Approach: | They propose a multi-task learning problem to solve a language data bottleneck . they propose to use word emotion induction as an individual task to predict emotion . |
| Outcome: | The proposed model outperforms a wide range of other methods on 9 languages and 15 conditions. |
A Multi-task Learning Framework for Opinion Triplet Extraction (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to Aspect-based sentiment analysis (ABSA) use aspect terms and their corresponding sentiment polarities as a reference, but they lack opinion terms as . |
| Approach: | They propose a multi-task learning framework to extract aspect terms and opinion terms and parse their sentiment dependencies with a biaffine scorer. |
| Outcome: | The proposed framework outperforms baseline and state-of-the-art approaches on four SemEval benchmarks. |
Jointly Identifying Rhetoric and Implicit Emotions via Multi-Task Learning (2021.findings-acl)
Copied to clipboard
| Challenge: | Experimental results validate the benefit of the proposed model over the state-of-the-art baselines for rhetoric and emotion identification tasks. |
| Approach: | They propose a multi-task learning framework that can encode categorical correlation between tasks to improve rhetoric and emotion identification problem. |
| Outcome: | The proposed model can encode the categorical correlation between tasks to improve rhetoric and emotion identification problem. |
All-in-One: A Deep Attentive Multi-task Learning Framework for Humour, Sarcasm, Offensive, Motivation, and Sentiment on Memes (2020.aacl-main)
Copied to clipboard
| Challenge: | Empirical results show the efficacy of our proposed multi-task framework over existing state-of-the-art systems. |
| Approach: | They propose a multi-task, multi-modal deep learning framework to solve multiple tasks simultaneously. |
| Outcome: | The proposed framework performs better than existing state-of-the-art systems on a complicated form of information, i.e., memes. |