Challenge: Existing models for improving consistency often train with additional NLI labels or attach trained extra modules to the generative agent.
Approach: They propose to encode personas into dialogue embeddings and a persona-conditioned dialogue dataset to improve persona consistency.
Outcome: The proposed approach can enforce dialogue agents to refrain from contradictions and improve consistency of existing models.

Similar Papers

Am I Me or You? State-of-the-Art Dialogue Models Cannot Maintain an Identity (2022.findings-naacl)

Copied to clipboard

Challenge: State-of-the-art open-domain dialogue models fail to maintain character identity throughout discourse . despite improvements in accuracy and self-contradiction, agents take on the role of interlocutor .
Approach: They formalize and quantify the deficiency in character identity modeling by using human evaluations.
Outcome: The proposed models reduce mistaken identity issues by nearly 65% according to human annotators while improving engagingness.
Persona-Consistent Dialogue Generation via Pseudo Preference Tuning (2025.coling-main)

Copied to clipboard

Challenge: Existing methods for improving persona consistency in dialogues require external resources.
Approach: They propose a method for enhancing persona consistency in dialogue response generation using direct preference optimization using persona data.
Outcome: The proposed method produces more consistent and natural responses than previous methods.
Learning to Improve Persona Consistency in Multi-party Dialogue Generation via Text Knowledge Enhancement (2022.coling-1)

Copied to clipboard

Challenge: Existing methods suffer from incomprehensive persona tags that have unique and obscure meanings to describe human’s personality.
Approach: They propose a graph convolution network model with addressee selecting mechanism that integrates personas, dialogue utterances, and external text knowledge in a unified graph.
Outcome: The proposed model outperforms baselines by large margins and improves persona consistency in the generated responses.
Personalizing Dialogue Agents via Meta-Learning (P19-1)

Copied to clipboard

Challenge: Existing personalized dialogue models use human designed persona descriptions to improve dialogue consistency.
Approach: They propose to extend Model-Agnostic Meta-Learning (MAML) to personalized dialogue learning without using persona descriptions.
Outcome: The proposed model outperforms baseline models in terms of human-evaluated fluency and consistency on a persona-chat dataset.
Enhancing Persona Consistency for LLMs’ Role-Playing using Persona-Aware Contrastive Learning (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for analyzing and analyzing large language models (LLMs) lack of emotion and fine-grained role awareness limits the model’s ability to provide personalized and diverse interactions further.
Approach: They propose an annotation-free framework to align LLMs’ behavior during role-playing, enhancing the model’s role consistency.
Outcome: The proposed framework outperforms vanilla LLMs under automatic evaluation methods and human expert evaluation.
Generate, Delete and Rewrite: A Three-Stage Framework for Improving Persona Consistency of Dialogue Generation (2020.acl-main)

Copied to clipboard

Challenge: Existing persona-based dialogue models generate human-like responses but can hardly avoid the generation of inconsistent persona words.
Approach: They propose a framework that deletes inconsistent words from a generated response prototype and further rewrites it to a personality-consistent one.
Outcome: The proposed framework achieves good performance on the persona-chat dataset.
Beyond Candidates : Adaptive Dialogue Agent Utilizing Persona and Knowledge (2023.findings-emnlp)

Copied to clipboard

Challenge: a previous study suggested that human dialogue systems ground persona and knowledge but they require incomplete candidate sets.
Approach: They propose an adaptive dialogue agent that uses persona and knowledge without candidate sets . their model generates consistent and relevant persona descriptions and identifies relevant knowledge .
Outcome: The proposed model outperforms baselines that ground persona and knowledge candidates even with fragmentary information.
Persona Expansion with Commonsense Knowledge for Diverse and Consistent Response Generation (2023.eacl-main)

Copied to clipboard

Challenge: Existing researches have focused on generating diverse and consistent responses based on personal traits.
Approach: They propose a consistent persona expansion framework that improves not only the diversity but also the consistency of persona-based responses.
Outcome: The proposed framework improves not only the diversity but also the consistency of persona-based responses on the Persona-Chat dataset.
Dialogue Natural Language Inference (P19-1)

Copied to clipboard

Challenge: Consistency is a long standing issue faced by dialogue models.
Approach: They propose to frame the consistency of dialogue agents as natural language inference and create a new natural language dataset called Dialogue NLI.
Outcome: The proposed model can improve the consistency of a dialogue model with human evaluation and automatic metrics on a suite of evaluation sets designed to measure the model’s consistency.
A Personalized Dialogue Generator with Implicit User Persona Detection (2022.coling-1)

Copied to clipboard

Challenge: Existing models for personalized dialogue generation tend to be self-centered, with little care for the user in the dialogue.
Approach: They propose a personalized dialogue generator by detecting an implicit user persona and using conditional variational inference to model the user's potential persona with no external knowledge.
Outcome: The proposed model improves both automatic metrics and human evaluations by focusing on the user's persona and posterior-discriminated regularization.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations