IP-Dialog: Evaluating Implicit Personalization in Dialogue Systems with Synthetic Data (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Traditional data generation methods are labor-intensive, resource-demanding, and raise privacy concerns. |
| Approach: | They propose an automatic synthetic data generation approach and introduce the **I**mplicit **P**ersonalized **Dialog**ue benchmark along with a training dataset, covering 10 tasks and 12 user attribute types. |
| Outcome: | The proposed approach incorporates the **Implicit **P**ersonalized **Dialog**ue benchmark along with a training dataset, covering 10 tasks and 12 user attribute types. |
Similar Papers
A Personalized Dialogue Generator with Implicit User Persona Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models for personalized dialogue generation tend to be self-centered, with little care for the user in the dialogue. |
| Approach: | They propose a personalized dialogue generator by detecting an implicit user persona and using conditional variational inference to model the user's potential persona with no external knowledge. |
| Outcome: | The proposed model improves both automatic metrics and human evaluations by focusing on the user's persona and posterior-discriminated regularization. |
Recent Trends in Personalized Dialogue Generation: A Review of Datasets, Methodologies, and Evaluations (2024.lrec-main)
Copied to clipboard
| Challenge: | Personalization is a multifaceted process that requires multiple definitions and varies between individuals. |
| Approach: | They propose to systemically survey the recent landscape of personalized dialogue generation including the datasets employed, methodologies developed, and evaluation metrics applied. |
| Outcome: | The proposed model can generate fluent and coherent responses to human queries in a language-based conversational agent. |
Leveraging Implicit Feedback from Deployment Data in Dialogue (2024.eacl-short)
Copied to clipboard
| Challenge: | Xu et al., 2023) and Bai ed., 2019) use crowdworkers to collect signals from natural dialogue episodes. |
| Approach: | They use the publicly released BlenderBot deployment data to extract signals from conversations to implicitly measure the quality of a machine-generated utterance. |
| Outcome: | The proposed model improves over baseline models, but some proxy signals can lead to undesirable generations. |
What is wrong with you?: Leveraging User Sentiment for Automatic Dialog Evaluation (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing metrics for dialog evaluation are trained on human annotations, which is cumbersome to collect. |
| Approach: | They propose to use user sentiment and other information as proxy to measure the quality of previous dialogs. |
| Outcome: | The proposed model is comparable to models trained on human annotated data. |
Synthesizing Conversations from Unlabeled Documents using Automatic Response Segmentation (2024.findings-acl)
Copied to clipboard
| Challenge: | Several datasets have been developed for building conversational question answering systems. |
| Approach: | They propose a robust dialog synthesising method that learns segmentation instead of using sentence boundaries. |
| Outcome: | The proposed method achieves superior quality when compared to WikiDialog . it also improves performance across OR-QuAC benchmarks . |
Regularizing Dialogue Generation by Imitating Implicit Scenarios (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for dialogue generation lack the flexibility to handle such freedoms. |
| Approach: | They propose to take into account dialogue history and future conversation to implicitly reconstruct the scenario knowledge. |
| Outcome: | The proposed approach outperforms state-of-the-art models on diversity and relevance and expresses scenario-specific knowledge. |
“In-Dialogues We Learn”: Towards Personalized Dialogue Without Pre-defined Profiles through In-Dialogue Learning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to personalized dialogue generate pre-defined profiles that are time-consuming and labor-intensive to create. |
| Approach: | They propose a framework that leverages dialogue history to characterize personas without pre-defined profiles. |
| Outcome: | The proposed framework improves BLEU and ROUGE scores on three datasets and human evaluations further validate the proposed method. |
Dialogizer: Context-aware Conversational-QA Dataset Generation from Textual Sources (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing dialog inpainting methods generate ConvQA datasets with low contextual relevance due to insufficient learning of question-answer alignment. |
| Approach: | They propose a dialog inpainting method that generates ConvQA datasets from documents . they propose re-ranking tasks and a framework that generate contextually relevant questions . |
| Outcome: | The proposed framework generates ConvQA datasets with high contextual relevance from textual sources. |
DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation (2022.acl-long)
Copied to clipboard
Wei Chen, Yeyun Gong, Song Wang, Bolun Yao, Weizhen Qi, Zhongyu Wei, Xiaowu Hu, Bartuer Zhou, Yi Mao, Weizhu Chen, Biao Cheng, Nan Duan
| Challenge: | Existing pre-trained dialog models shed light on various downstream tasks in natural language processing (NLP). |
| Approach: | They propose a dialog pre-training framework that introduces latent variables into the enhanced encoder-decoder pre-train framework to increase relevance and diversity of responses. |
| Outcome: | The proposed model achieves state-of-the-art on personaChat, DailyDialog, and DSTC7-AVSD datasets. |
CausalDialogue: Modeling Utterance-level Causality in Conversations (2023.findings-acl)
Copied to clipboard
| Challenge: | Despite widespread adoption, neural conversation models have yet to exhibit natural chat capabilities with humans . despite their widespread adoption in society, chatbots have yet not shown natural chat capability . |
| Approach: | They propose a causality-enhanced method to enhance the impact of causality at the utterance level in training neural conversation models. |
| Outcome: | The proposed method improves diversity and agility of loss functions and still needs improvement . the proposed method is based on a CausalDialogue dataset . |