EmpathicStories++: A Multimodal Dataset for Empathy Towards Personal Experiences (2024.findings-acl)
Copied to clipboard
Jocelyn Shen, Yubin Kim, Mohit Hulse, Wazeer Zulfikar, Sharifa Alghowinem, Cynthia Breazeal, Hae Park
| Challenge: | Existing datasets for empathy modeling are limited in the ways they are not captured in the wild. |
| Approach: | They propose a multimodal dataset for empathy during personal experience sharing that contains 53 hours of video, audio, and text data of 41 participants. |
| Outcome: | The EmpathicStories++ dataset contains 53 hours of video, audio, and text data of 41 participants sharing vulnerable experiences and reading empathically resonant stories with an AI agent. |
Similar Papers
Modeling Empathic Similarity in Personal Narratives (2023.emnlp-main)
Copied to clipboard
| Challenge: | EmpathicStories is a dataset of 1,500 personal stories annotated with empathic similarity features and 2,000 pairs of stories annnotated by empathism. |
| Approach: | They propose a task to identify similarity in personal stories based on empathic resonance . they use a dataset of 1,500 personal stories annotated with empathism features . |
| Outcome: | The proposed model outperforms semantic similarity models on correlation and retrieval metrics. |
From Traits to Empathy: Personality-Aware Multimodal Empathetic Response Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing approaches focus on acquiring affective and cognitive knowledge from text, but neglect the unique personality traits of individuals and the inherently multimodal nature of human face-to-face conversation. |
| Approach: | They propose a multimodal dialogue system that generates empathetic responses from a perspective that considers the personality traits of users. |
| Outcome: | The proposed system generates empathetic responses from a multimodal perspective and analyzes multimodal data to understand the user’s emotional state and situation. |
AcnEmpathize: A Dataset for Understanding Empathy in Dermatology Conversations (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on empathy and mental health-related corpora focus on broader contexts and lack domain specificity. |
| Approach: | They propose a dataset that captures empathy expressed in acne-related discussions from forum posts focused on its emotional and psychological effects. |
| Outcome: | The AcnEmpathize dataset shows that it performs well at empathy classification. |
Towards Empathetic Open-domain Conversation Models: A New Benchmark and Dataset (P19-1)
Copied to clipboard
| Challenge: | EmpatheticDialogues dataset provides a benchmark for empathetic dialogue generation . human evaluators perceive dialogue models as more epathetic . |
| Approach: | They propose a benchmark for empathetic dialogue generation from a dataset of 25k conversations grounded in emotional situations. |
| Outcome: | The proposed benchmarks show that existing models are perceived to be more empathetic by human evaluators compared to models trained on large-scale Internet conversations. |
A Taxonomy of Empathetic Response Intents in Human Social Conversations (2020.coling-main)
Copied to clipboard
| Challenge: | Open-domain conversational agents or chatbots are becoming increasingly popular in the natural language processing community. |
| Approach: | They aim to combine dialogue act/intent modelling and neural response generation to produce a large-scale taxonomy for empathetic response intents. |
| Outcome: | The proposed method improves the response quality of chatbots and makes them more controllable and interpretable. |
Can Machines Resonate with Humans? Evaluating the Emotional and Empathic Comprehension of LMs (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Empathy plays a pivotal role in fostering prosocial behavior, often triggered by the sharing of personal experiences through narratives. |
| Approach: | They propose to use contrastive learning with masked LMs and supervised fine-tuning with large language models to improve empathy understanding in NLP models. |
| Outcome: | The proposed methods show that there is low agreement among annotators and that cultural differences are a factor in their interpretation of empathy. |
EmpHi: Generating Empathetic Responses with Human-like Intents (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing empathetic dialogue models lack emotion-dependent response generation . elaine mccartney: "i'm sorry to hear that! " |
| Approach: | They propose a model to generate empathetic responses with human-consistent intents . they aim to address the bias of the empathic intent distribution between epd models and humans . |
| Outcome: | The proposed model outperforms state-of-the-art models in terms of empathy, relevance, and diversity on automatic and human evaluation. |
A Large-Scale Dataset for Empathetic Response Generation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing empathetic datasets are limited in size and cost due to the cost of manual labor. |
| Approach: | They propose to annotate 1M dialogues with 32 fine-grained emotions and eight empathetic response intents and the Neutral category using a silver dataset. |
| Outcome: | The proposed pipeline compares the quality of the proposed dataset with a state-of-the-art gold dataset using offline experiments and visual validation methods. |
EmpathyEar: An Open-source Avatar Multimodal Empathetic Chatbot (2024.acl-demos)
Copied to clipboard
| Challenge: | EmpathyEar is an open-source, avatar-based multimodal empathetic chatbot . currently, ERG systems rely on text, sound, and vision . |
| Approach: | They propose an open-source, avatar-based multimodal empathetic chatbot to fill the gap in traditional text-only ERG systems. |
| Outcome: | The proposed system enables users to generate emotional responses to user queries . it can also generate avatars with talking faces and synchronized speeches . |
A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Support (2020.emnlp-main)
Copied to clipboard
| Challenge: | Empathy measurement has predominantly occurred in synchronous, face-to-face settings, and may not translate to asynchronous, text-based contexts. |
| Approach: | They propose a computational approach to understanding how empathy is expressed in online mental health platforms. |
| Outcome: | The proposed model can identify empathic conversations and extract rationales from them. |