Does GPT-3 Generate Empathetic Dialogues? A Novel In-Context Example Selection Method and Automatic Evaluation Metric for Empathetic Dialogue Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Empathy is a multi-dimensional concept consisting of cognitive and affective aspects. |
| Approach: | They propose two new in-context example selection methods that utilize emotion and situational information. |
| Outcome: | The proposed method is effective in measuring the degree of human empathy. |
Similar Papers
Harnessing the Power of Large Language Models for Empathetic Response Generation: Empirical Investigations and Improvements (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Empathetic dialogue is an essential part of building harmonious social relationships and contributes to the development of a helpful AI. |
| Approach: | They propose three methods to improve the performance of large language models (LLMs) they propose semantically similar in-context learning, two-stage interactive generation and combination with the knowledge base. |
| Outcome: | The proposed methods achieve state-of-the-art in automatic and human evaluations and the possibility of GPT-4 simulating human evaluators. |
EMPATH: An Ensemble Method for Automatic Fine-Grained Turn-Level Dialogue Empathy Evaluation with a Novel Emotional Distance Metric (2026.findings-acl)
Copied to clipboard
| Challenge: | Empathy evaluation metrics are lacking in the competitions, and classical dialogue evaluation metrics require further investigation. |
| Approach: | They propose a framework which combines fine-tuned models, large language models, classical dialogue evaluation metrics, and a novel metric. |
| Outcome: | The proposed framework improves on the WASSA 2024 benchmark and shows a statistically significant 8% improvement on the EX dataset. |
Towards Empathetic Open-domain Conversation Models: A New Benchmark and Dataset (P19-1)
Copied to clipboard
| Challenge: | EmpatheticDialogues dataset provides a benchmark for empathetic dialogue generation . human evaluators perceive dialogue models as more epathetic . |
| Approach: | They propose a benchmark for empathetic dialogue generation from a dataset of 25k conversations grounded in emotional situations. |
| Outcome: | The proposed benchmarks show that existing models are perceived to be more empathetic by human evaluators compared to models trained on large-scale Internet conversations. |
Multi-Party Empathetic Dialogue Generation: A New Task for Dialog Systems (2022.acl-long)
Copied to clipboard
| Challenge: | Existing work on empathetic dialogues focused on the two-party scenario, but multi-party dialogues are pervasive in reality. |
| Approach: | They propose a multi-party empathetic dialogue generation task that uses a static-dynamic model to explore emotion and sensibility. |
| Outcome: | The proposed task is based on a model with static sensibility and dynamic emotion . it achieves state-of-the-art performance in multi-party empathetic dialogue learning . |
Improving Empathetic Dialogue Generation by Dynamically Infusing Commonsense Knowledge (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work on generating empathetic responses by utilizing the speaker's emotion has not been successful. |
| Approach: | They propose an approach which incorporates an adaptive module for commonsense knowledge selection to ensure consistency between the generated empathetic responses and the speaker’s situation. |
| Outcome: | The proposed approach outperforms baseline models in both automatic and human evaluations, exhibiting the generation of more coherent and empathetic responses. |
CASE: Aligning Coarse-to-Fine Cognition and Affection for Empathetic Response Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing empathetic dialogue models only consider the affective aspect of empathy, which limits the capability of emotional response generation. |
| Approach: | They propose a model that aligns the user's cognition and affection at both the coarse-grained and fine-grounded levels and then automatically and manually evaluates the model. |
| Outcome: | The proposed model outperforms state-of-the-art models and generates more empathetic and informative responses. |
EmpCRL: Controllable Empathetic Response Generation via In-Context Commonsense Reasoning and Reinforcement Learning (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies lack the perception of fine-grained dialogue emotion propagation, and have limitations in reasoning about the intentions of users on cognition, which affect the quality of empathetic response. |
| Approach: | They propose to use commonsense reasoning and reinforcement learning to generate empathetic response based on in-context commonsensing and contextual reasoning to broaden cognitive boundaries. |
| Outcome: | The proposed model outperforms state-of-the-art models in automatic and human evaluation. |
Empathetic Dialogue Generation via Sensitive Emotion Recognition and Sensible Knowledge Selection (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Empathy is a key trait of everyday human conversations. |
| Approach: | They propose a serial encoding and Emotion-Knowledge interaction method for empathetic dialogue generation which is more sensitive to emotion dynamics in conversations. |
| Outcome: | The proposed method outperforms baseline evaluations on the utterance-level annotated EMPATHETICDIALOGUES. |
EmpHi: Generating Empathetic Responses with Human-like Intents (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing empathetic dialogue models lack emotion-dependent response generation . elaine mccartney: "i'm sorry to hear that! " |
| Approach: | They propose a model to generate empathetic responses with human-consistent intents . they aim to address the bias of the empathic intent distribution between epd models and humans . |
| Outcome: | The proposed model outperforms state-of-the-art models in terms of empathy, relevance, and diversity on automatic and human evaluation. |
EmpDG: Multi-resolution Interactive Empathetic Dialogue Generation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing work on empathetic dialogue generation fails to capture the nuances of human emotion and consider the potential of user feedback. |
| Approach: | They propose a multi-resolution adversarial model - EmpDG - to generate more empathetic responses by exploiting both coarse-grained dialogue-level and fine-grounded token-level emotions. |
| Outcome: | The proposed model outperforms the state-of-the-art models in both content quality and emotion perceptivity. |