Beyond Sentence-level Labels: Integrating Conversational Context and Personal Experience for Natural Emotional Expression (2026.findings-acl)
Copied to clipboard
Haiyang Sun, Chenyang Le, Wei Wang, Leying Zhang, Chuang Li, Bing Han, Chenda Li, Mengxiao Bi, Yanmin Qian
| Challenge: | Existing systems rely on sentence-level labels, which fails to capture the subtle nuances of human affect. |
| Approach: | They propose to use a large-scale, context-aware speech corpus derived from multi-speaker audiobooks to generate a speech that is human-like. |
| Outcome: | The proposed model outperforms existing methods in terms of emotional expression accuracy and naturalness. |
Similar Papers
Prompt-Guided Selective Masking Loss for Context-Aware Emotive Text-to-Speech (2025.findings-naacl)
Copied to clipboard
| Challenge: | Emotional dialogue speech synthesis (EDSS) aims to generate expressive speech by leveraging the dialogue context between interlocutors. |
| Approach: | They propose a large language model to generate holistic emotion tags based on prior dialogue context and pinpoint key words in the target utterance that align with the predicted emotional state. |
| Outcome: | The proposed method improves emotional expressiveness and facilitates automatic emotion speech generation during inference. |
Computational Narrative Understanding for Expressive Text-to-Speech (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in text-to-speech systems have been driven by large, multi-domain speech corpora. |
| Approach: | They propose a large-scale 5.3K hours of expressive speech drawn from character quotations . they fine-tune a flow-matching model and train from scratch . |
| Outcome: | The proposed model improves expressivity and intelligibility while training from scratch improves expressiveness of an autoregressive model. |
The Correlation Between Emotion in Text and Speech Segments is Limited: A Cross-Modal Study (2026.findings-eacl)
Copied to clipboard
| Challenge: | a recent study has shown that text-to-speech systems can capture human-like emotion, but they lack the ability to predict emotion in speech. |
| Approach: | They propose to use 8 large language models for identifying emotion in text and 2 audio models for emotion in speech to investigate the correlation between emotion and speech. |
| Outcome: | The proposed models perform well on emotion recognition from situational text and audiobooks, but show weak correlation for Valence only. |
Enhancing Emotional Support Conversations: A Framework for Dynamic Knowledge Filtering and Persona Extraction (2025.coling-main)
Copied to clipboard
| Challenge: | Existing dialogue models struggle to interpret context accurately due to irrelevant or misclassified knowledge, limiting their effectiveness in real-world scenarios. |
| Approach: | They propose a framework that dynamically filters relevant commonsense knowledge and extracts personalized information to improve empathetic dialogue generation. |
| Outcome: | The proposed framework outperforms existing models in coherence, emotional understanding, and response relevance on the ESConv dataset. |
Beyond Context to Cognitive Appraisal: Emotion Reasoning as a Theory of Mind Benchmark for Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have shown that large language models (LLMs) reason about others' emotional states using contextual information, within a Theory-of-Mind framework. |
| Approach: | They propose to use large language models to reason about others’ emotional states using contextual information within a Theory-of-Mind framework. |
| Outcome: | The proposed models can reason about situations and appraisals, but are poor at associating situational outcomes and appraisal with specific emotions. |
From Multilingual Complexity to Emotional Clarity: Leveraging Commonsense to Unveil Emotions in Code-Mixed Dialogues (2023.emnlp-main)
Copied to clipboard
| Challenge: | Understanding emotions during conversation is a fundamental aspect of human communication. |
| Approach: | They propose an approach that integrates commonsense information with dialogue context to facilitate a deeper understanding of emotions. |
| Outcome: | The proposed approach improves ERC for code-mixed conversations by integrating commonsense with dialogue context. |
When Words Smile: Generating Diverse Emotional Facial Expressions from Text (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems that generate only coarse facial expressions ignore the rich and dynamic nature of face-to-face communication. |
| Approach: | They propose an end-to-end text-to expression model that explicitly focuses on emotional dynamics. |
| Outcome: | The proposed model outperforms baselines on 15,000 text–3D expression pairs on a large-scale dataset. |
EDA: Enriching Emotional Dialogue Acts using an Ensemble of Neural Annotators (2020.lrec-1)
Copied to clipboard
| Challenge: | Emotion recognition helps to build natural dialogue systems. |
| Approach: | They propose to use a recurrent neural model to annotate emotion corpora with dialogue act labels and an ensemble annotator to extract the final dialogue act label. |
| Outcome: | The proposed model annotates two accessible multi-modal emotion corpora with and without context and extracts the final dialogue act label. |
Exploring the Role of Context in Utterance-level Emotion, Act and Intent Classification in Conversations: An Empirical Study (2021.findings-acl)
Copied to clipboard
| Challenge: | utterance-level dialogue understanding tasks are often performed at utterrance level and are often conjoined together under the umbrella of utterence-level dialog understanding. |
| Approach: | They propose to use a contextual utterance-level dialogue understanding baseline as a strong framework for six dialogue-understanding tasks. |
| Outcome: | The proposed framework can be easily adapted for other tasks for similar purposes. |
Guilt by Association: Emotion Intensities in Lexical Representations (2021.emnlp-main)
Copied to clipboard
| Challenge: | linguistic models have a higher correlation with human ground truth ratings than labeled data . word vectors have often been evaluated on standard word relatedness benchmarks . |
| Approach: | They propose to use unsupervised, supervised, and finally supervised methods to extract emotional associations from pretrained vectors and models. |
| Outcome: | The proposed method shows higher correlation with ground truth ratings than state-of-the-art lexicons based on labeled data. |