ES4R: Speech Encoding Based on Prepositive Affective Modeling for Empathetic Response Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing speech-to-speech large language models rely on ASR transcription or use encoders to extract latent representations, weakening affective information and contextual coherence in multi-turn dialogues. |
| Approach: | They propose a framework for speech-based empathetic response generation that captures turn-level affective states and dialogue-level emotional dynamics. |
| Outcome: | The proposed framework outperforms baselines in automatic and human evaluations and remains robust across different Large Language Model (LLM) backbones. |
Similar Papers
Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible Knowledge Selection (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Empathy is a key trait of everyday human conversations. |
| Approach: | They propose a serial encoding and Emotion-Knowledge interaction method for empathetic dialogue generation which is more sensitive to emotion dynamics in conversations. |
| Outcome: | The proposed method outperforms baseline evaluations on the utterance-level annotated EMPATHETICDIALOGUES. |
Harnessing the Power of Large Language Models for Empathetic Response Generation: Empirical Investigations and Improvements (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Empathetic dialogue is an essential part of building harmonious social relationships and contributes to the development of a helpful AI. |
| Approach: | They propose three methods to improve the performance of large language models (LLMs) they propose semantically similar in-context learning, two-stage interactive generation and combination with the knowledge base. |
| Outcome: | The proposed methods achieve state-of-the-art in automatic and human evaluations and the possibility of GPT-4 simulating human evaluators. |
Prompt-Guided Selective Masking Loss for Context-Aware Emotive Text-to-Speech (2025.findings-naacl)
Copied to clipboard
| Challenge: | Emotional dialogue speech synthesis (EDSS) aims to generate expressive speech by leveraging the dialogue context between interlocutors. |
| Approach: | They propose a large language model to generate holistic emotion tags based on prior dialogue context and pinpoint key words in the target utterance that align with the predicted emotional state. |
| Outcome: | The proposed method improves emotional expressiveness and facilitates automatic emotion speech generation during inference. |
Modelling Context Emotions using Multi-task Learning for Emotion Controlled Dialog Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent research has tackled this task using neural generative methods by augmenting emotion classes with the input sequences. |
| Approach: | They propose to use a self-attention based encoder and a decoder with dot product attention mechanism to generate a viable response with a specified emotion. |
| Outcome: | The proposed model outperforms baselines on automatic evaluation measures such as F1 and BLEU scores, thus resulting in more fluent and adequate responses. |
From Traits to Empathy: Personality-Aware Multimodal Empathetic Response Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Existing approaches focus on acquiring affective and cognitive knowledge from text, but neglect the unique personality traits of individuals and the inherently multimodal nature of human face-to-face conversation. |
| Approach: | They propose a multimodal dialogue system that generates empathetic responses from a perspective that considers the personality traits of users. |
| Outcome: | The proposed system generates empathetic responses from a multimodal perspective and analyzes multimodal data to understand the user’s emotional state and situation. |
ECC: Synergizing Emotion, Cause and Commonsense for Empathetic Dialogue Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Empathy improves human-machine dialogue systems by enhancing the user's experience. |
| Approach: | They propose a framework that leverages specialized encoders to capture the key features of emotion, cause, and commonsense and collaboratively models these through a Conditional Variational Auto-Encoder. |
| Outcome: | Empirical results show that the framework outperforms baseline models and offers a robust solution for empathetic dialogue generation. |
E-CORE: Emotion Correlation Enhanced Empathetic Dialogue Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Empathy is a desirable human trait that improves the emotional perceptivity in emotion-bonding social activities. |
| Approach: | They propose a framework that integrates emotion correlation learning, utilization, and supervising. |
| Outcome: | The proposed framework improves empathetic perception and expression on a humanized dialogue dataset. |
EmpCRL: Controllable Empathetic Response Generation via In-Context Commonsense Reasoning and Reinforcement Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies lack the perception of fine-grained dialogue emotion propagation, and have limitations in reasoning about the intentions of users on cognition, which affect the quality of empathetic response. |
| Approach: | They propose to use commonsense reasoning and reinforcement learning to generate empathetic response based on in-context commonsensing and contextual reasoning to broaden cognitive boundaries. |
| Outcome: | The proposed model outperforms state-of-the-art models in automatic and human evaluation. |
Non-Emotion-Centric Empathetic Dialogue Generation (2025.coling-main)
Copied to clipboard
| Challenge: | Empathy is a social psychology theory that enables individuals to comprehend each other's experiences and emotions, thereby fostering more intimate interpersonal relationships. |
| Approach: | They propose a framework for empathetic dialogue generation based on contrastive learning and context-sensitive entity and social commonsense that punishes responses with incorrect emotions and improves the quality of emotions. |
| Outcome: | The proposed framework improves the quality of empathetic generation and generates more diverse responses in comparison with the state-of-the-art baselines. |
BLSP-Emo: Towards Empathetic Large Speech-Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | BLSP-Emo model understands both semantics and emotions in speech and generates empathetic responses. |
| Approach: | They propose a language-speech pretraining with emotion support that utilizes existing speech and emotion recognition datasets to create an end-to-end speech-language model. |
| Outcome: | The proposed model can understand both semantics and emotions in speech and generate empathetic responses. |