MEISD: A Multimodal Multi-Label Emotion, Intensity and Sentiment Dialogue Dataset for Emotion Recognition and Sentiment Analysis in Conversations (2020.coling-main)
Copied to clipboard
| Challenge: | Emotion and sentiment classification in dialogues has gained popularity in recent times . a number of datasets are imbalanced in representing different emotions and consist of an only single emotion. |
| Approach: | They propose to use a dataset to analyze emotions and sentiments in dialogues . they use text, audio and video to identify the correct emotions with the appropriate intensity and sentiment in an utterance of a dialogue . |
| Outcome: | The proposed datasets are balanced in representing different emotions and consist of only one emotion. |
Similar Papers
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations (P19-1)
Copied to clipboard
| Challenge: | Emotion recognition in conversations has gained popularity due to its potential applications. Until now, a large multimodal multi-party emotional conversational database containing more than two speakers per dialogue was missing. |
| Approach: | They propose to extend and enhance EmotionLines by combining 13,000 utterances from Friends dialogues with emotion and sentiment labels. |
| Outcome: | The proposed dataset contains about 13,000 utterances from 1,433 dialogues from the TV-series Friends. |
MPDD: A Multi-Party Dialogue Dataset for Analysis of Emotions and Interpersonal Relationships (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing datasets with emotion and relation labels for dialogues are limited. |
| Approach: | They use a Chinese dialogue dataset to annotate emotions and interpersonal relationships on each utterance. |
| Outcome: | The proposed dataset contains 25,548 utterances from 4,142 dialogues. |
EmoInHindi: A Multi-label Emotion and Intensity Annotated Dataset in Hindi for Emotion Recognition in Dialogues (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing datasets for emotion recognition in dialogues are in English . existing datasets are limited to a few languages like Hindi . |
| Approach: | They propose a large conversational dataset in Hindi for multi-label emotion and intensity recognition in conversations . they use a Wizard-of-Oz manner to annotate dialogues with 16 emotion labels . |
| Outcome: | The proposed dataset contains 1,814 dialogues with 44,247 utterances in Hindi . it is based on a Wizard-of-Oz manner and can detect emotions in conversation . |
UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies study sentiment and emotion separately and do not fully exploit the complementary knowledge behind the two. |
| Approach: | They propose a multimodal sentiment knowledge-sharing framework that unifies MSA and ERC tasks from features, labels, and models. |
| Outcome: | The proposed framework achieves consistent improvements on four public benchmark datasets on MOSI, MOSEI, MELD, and IEMOCAP. |
Multimodal Emotion Recognition in Conversations: A Survey of Methods, Trends, Challenges and Prospects (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Multimodal Emotion Recognition in Conversations (MERC) is a new way to enhance human-computer interaction. |
| Approach: | This survey offers a systematic overview of Multimodal Emotion Recognition in Conversations . it examines motivations, core tasks, representative methods, and evaluation strategies . |
| Outcome: | The survey examines the effectiveness of MERC and its evaluation strategies. |
EmotionLines: An Emotion Corpus of Multi-Party Conversations (L18-1)
Copied to clipboard
| Challenge: | Emotion is a critical characteristic to distinguish people from machines. |
| Approach: | They propose a dataset with emotions labeling on all utterances in each dialogue . they use Friends TV scripts and Facebook messenger dialogues to collect the data . |
| Outcome: | The proposed dataset is the first with emotions labeling on all utterances in each dialogue based on their textual content. |
M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Database (2022.acl-long)
Copied to clipboard
| Challenge: | Existing data resources to support multimodal affective analysis in dialogues are limited in scale and diversity. |
| Approach: | They propose a multimodal multi-scene multi-label Emotional Dialogue dataset, M3ED, which contains 990 dyadic emotional dialogues from 56 different TV series. |
| Outcome: | The proposed dataset contains 990 dyadic emotional dialogues from 56 different TV series, a total of 9,082 turns and 24,449 utterances. |
A Multimodal Corpus for Emotion Recognition in Sarcasm (2022.lrec-1)
Copied to clipboard
| Challenge: | sarcasm and emotion are often used in conversational systems to generate the right response. |
| Approach: | They use a sarcastic expression dataset pre-annotated with 9 emotions to detect emotion . they identify and correct 343 incorrect emotion labels and label each sarkastic utterance with one of four sarcasm types. |
| Outcome: | The proposed model outperforms state-of-the-art sarcasm detection methods by using a multimodal sarcastic detection dataset. |
Aspect-Based Emotion Analysis and Multimodal Coreference: A Case Study of Customer Comments on Adidas Instagram Posts (2022.lrec-1)
Copied to clipboard
| Challenge: | Aspect-based sentiment analysis of user-generated content has been relatively unexplored in recent years. |
| Approach: | They present a multimodal dataset for Aspect-Based Emotion Analysis (ABEA) they take the first steps in investigating the utility of multimodal coreference resolution in an ABEA framework. |
| Outcome: | The proposed dataset consists of 4,900 comments on 175 images and is annotated with aspect and emotion categories and the emotional dimensions of valence and arousal. |
MELD-ST: An Emotion-aware Speech Translation Dataset (2024.findings-acl)
Copied to clipboard
Sirou Chen, Sakiko Yahata, Shuichiro Shimizu, Zhengdong Yang, Yihang Li, Chenhui Chu, Sadao Kurohashi
| Challenge: | Emotion plays a crucial role in human conversation. |
| Approach: | They present a MELD-ST dataset for the emotion-aware speech translation task . they show that fine-tuning with emotion labels can enhance translation performance . |
| Outcome: | The proposed dataset shows that fine tuning with emotion labels can improve translation performance in some settings. |