EmoHarbor: Evaluating Personalized Emotional Support by Simulating the User’s Internal World (2026.acl-long)
Copied to clipboard
| Challenge: | EmoHarbor is an evaluation framework that rewards generic empathetic responses but fails to assess whether the support is genuinely personalized to users’ unique psychological profiles and contextual needs. |
| Approach: | They propose an automated evaluation framework that adopts a User-as-a-Judge paradigm by simulating the user's inner world. |
| Outcome: | The proposed framework decomposes users' internal processes into three specialized roles and defines 10 evaluation dimensions of personalized support quality. |
Similar Papers
From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) show great potential for expressing empathy, but often deliver generic responses that fail to address users’ specific needs. |
| Approach: | They propose a self-evolution framework to help LLMs improve their responses to better align with users’ implicit preferences concerning personality, emotional state, and specific context. |
| Outcome: | The proposed model significantly improves the model's performance in emotional support, reducing unhelpful responses and minimizing discrepancies between user preferences and model outputs. |
ESC-Judge: A Framework for Comparing Emotional Support Conversational Agents (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) increasingly power mental-health chatbots . yet the field lacks a scalable, theory-grounded way to decide which model is more effective to deploy. |
| Approach: | They propose a framework that grounds head-to-head comparisons of Emotional-Support LLMs in Hill’s Exploration–Insight–Action counselling model. |
| Outcome: | The proposed framework matches PhD-level annotators in 85% of Exploration, 83% of Insight, and 86% of Action decisions, demonstrating human-level reliability at a fraction of the cost. |
ChatAnime: Towards User-Centered Emotional Support in LLM-based Virtual Character Chat (2026.acl-long)
Copied to clipboard
| Challenge: | Existing research focuses on character consistency in fictional or game-based scenarios . ESRP framework is designed to align role-playing with real-world user scenarios based on emotional needs. |
| Approach: | They propose a framework to align role-playing with real-world user scenarios and emotional needs. |
| Outcome: | The proposed framework aligns role-playing with real-world user scenarios and emotional needs. |
Enhancing Emotional Support Conversations: A Framework for Dynamic Knowledge Filtering and Persona Extraction (2025.coling-main)
Copied to clipboard
| Challenge: | Existing dialogue models struggle to interpret context accurately due to irrelevant or misclassified knowledge, limiting their effectiveness in real-world scenarios. |
| Approach: | They propose a framework that dynamically filters relevant commonsense knowledge and extracts personalized information to improve empathetic dialogue generation. |
| Outcome: | The proposed framework outperforms existing models in coherence, emotional understanding, and response relevance on the ESConv dataset. |
EmotionQueen: A Benchmark for Evaluating Empathy of Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluations of emotional intelligence in large language models (LLMs) focus on basic sentiment analysis tasks, such as emotion recognition, which is not enough to evaluate LLMs’ overall emotional intelligence. |
| Approach: | They propose a framework for evaluating the emotional intelligence of large language models (LLMs) that includes four distinct tasks: Key Event Recognition, Mixed Event Recognition and Implicit Emotional Recognition. |
| Outcome: | The proposed framework includes four distinct tasks: Key Event Recognition, Mixed Event Recognition and Implicit Emotional Recognition. |
Stress-Testing Emotional Support Models: Moving from Homogeneous to Diverse Help Seekers (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing simulators fail to capture behavioral diversity of real-world seekers . lack of reliable automated evaluation frameworks hinders field's establishment . |
| Approach: | They propose a controllable seeker simulator driven by nine psychological and linguistic features that underpin seeker behavior. |
| Outcome: | The proposed model achieves superior profile adherence and behavioral diversity compared to existing approaches. |
Beyond Sentence-level Labels: Integrating Conversational Context and Personal Experience for Natural Emotional Expression (2026.findings-acl)
Copied to clipboard
Haiyang Sun, Chenyang Le, Wei Wang, Leying Zhang, Chuang Li, Bing Han, Chenda Li, Mengxiao Bi, Yanmin Qian
| Challenge: | Existing systems rely on sentence-level labels, which fails to capture the subtle nuances of human affect. |
| Approach: | They propose to use a large-scale, context-aware speech corpus derived from multi-speaker audiobooks to generate a speech that is human-like. |
| Outcome: | The proposed model outperforms existing methods in terms of emotional expression accuracy and naturalness. |
I Don’t Need Solution. I Need Emotional Support : Empathetic LLMs based on Emotional Validation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) struggle to generate emotional support response, despite observing and reflecting on the help-seeker’s situation . Empathy drives the formation of constructive interpersonal and supportive relationships, including counseling for mental health care . |
| Approach: | They propose to use a two-stage training process to enhance empathetic response generation through empathy acquisition and emotional validation alignment. |
| Outcome: | The proposed method significantly improves empathetic response generation, achieving superior performance in both automatic and human evaluations. |
EmoRes: Toward Adaptive Psychological Support via User-Agnostic Benchmark and Topic-Mining Agent (2026.findings-acl)
Copied to clipboard
Zhengwei Zou, Xuanming Jiang, Baoyi An, Dingyu Nie, Zhengxing Fang, Qingyu Liu, Xueming Qian, Guoshuai Zhao, Zhongyu Yang
| Challenge: | Large language models generate fragmented and emotionally inconsistent dialogues lacking the therapeutic structure necessary for reliable assessment. |
| Approach: | They propose a framework that boosts psychological reasoning via a Topic-Mining Emotional Agent and a multi-perspective Self-Reflection Agent. |
| Outcome: | The proposed framework improves topic continuity, emotional coherence, and clinical interpretability over baselines and validated by ablation studies and human evaluations. |
From Personas to Talks: Revisiting the Impact of Personas on LLM-Synthesized Emotional Support Conversations (2025.emnlp-main)
Copied to clipboard
| Challenge: | Experimental results show that LLMs can infer persona traits and subtle shifts in emotionality and extraversion occur . scalable solutions with reduced costs and enhanced data privacy are needed . |
| Approach: | They explore the role of personas in the creation of emotional support conversations by LLMs. |
| Outcome: | The proposed model can infer persona traits and maintain key persona characteristics while revealing shifts in emotionality and extraversion. |