Challenge: Large language models are increasingly deployed in multi-turn settings such as tutoring, support, and counseling where reliability depends on preserving consistent roles, personas, and goals across long horizons.
Approach: They propose a framework that decomposes LLM–LLM conversations into a modular, stability-first framework that allows for a stable persona-driven agent simulation for multi-turn dialogue generation.
Outcome: The proposed framework decomposes the LLM-based model into four main components: persona creation, plausibility validation, and natural-language persona crafting.

Similar Papers

MADS: Multi-Agent Dialogue Simulation for Diverse Persuasion Data Generation (2025.emnlp-industry)

Copied to clipboard

Challenge: Recent studies show that LLM-based agents exhibit superior moral and emotional language performance compared to humans, raising expectations for their deployment in persuasive tasks.
Approach: They propose a framework for generating persuasive multi-turn dialogues via agent self-play using user agents designed to simulate diverse persona-driven behaviors, a Dialog Agent executing task-oriented persuasion strategies and an Optimization Agent evaluating and refining dialogue outcomes.
Outcome: The proposed framework significantly improved the persuasion capacity of small LLMs, increasing the organic traffic conversion rate by 22.4% (from 1.83% to 2.24%) .
Large Scale Multi-Actor Generative Dialog Modeling (2020.acl-main)

Copied to clipboard

Challenge: Non-goal oriented dialog agents typically exhibit inconsistent personality across conversations or the average personality of all users.
Approach: They propose a model that conditionally models past conversations to probabilistically model multi-turn conversations in the actor’s persona.
Outcome: The proposed model improves perplexity on 1.7M held out Reddit conversations by 0.47 on scaling from 117M to 8.3B parameters.
Evaluating Conversational Agents with Persona-driven User Simulations based on Large Language Models: A Sales Bot Case Study (2025.emnlp-industry)

Copied to clipboard

Challenge: Recent advances in LLMs enable sophisticated user simulations that can replace traditional rule-based evaluations.
Approach: They propose a persona-driven approach to conversational agent evaluation using Large Language Models (LLMs) they introduce a dataset of customer personas, which are then used to configure a single LLM-based user simulator.
Outcome: The proposed model emulates nuanced customer roles and can implement cross-selling strategies with minimal impact on customer satisfaction, varying by customer type.
Persona-Grounded Safety Evaluation of AI Companions in Multi-Turn Conversations (2026.acl-long)

Copied to clipboard

Challenge: Existing safety evaluations rely on self-reported user data or interviews . a recent study evaluated how Replika responds to high-risk user groups .
Approach: They propose a framework for controlled simulation and safety evaluation of multi-turn interactions with AI companion applications.
Outcome: The proposed framework evaluates how Replika responds to high-risk user groups . it incorporates emotion modeling and LLM-assisted utterance-and harm-level classification .
A Framework for Exploring Player Perceptions of LLM-Generated Dialogue in Commercial Video Games (2023.findings-emnlp)

Copied to clipboard

Challenge: evaluating the player experience in a roleplaying game augmented with LLM-generated dialogue remains a major challenge.
Approach: They propose a dynamic evaluation framework for the dialogue management systems that govern the task-oriented dialogue often found in roleplaying video games.
Outcome: The proposed framework directly evaluates the performance of LLM-generated dialogue in a role-playing game with 28 players.
Hello Again! LLM-powered Personalized Agent for Long-term Dialogue (2025.naacl-long)

Copied to clipboard

Challenge: Existing dialogue systems focus on brief single-session interactions, neglecting real-world needs for long-term companionship and personalized interactions.
Approach: They propose a model-agnostic framework for long-term dialogue agents . they use event summary and persona management to enable reasoning .
Outcome: The proposed framework incorporates three independently tunable modules dedicated to event perception, persona extraction, and response generation.
Faithful Persona-based Conversational Dataset Generation with Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing datasets for training conversational AI models do not sufficiently model their users.
Approach: They propose a generator-critic architecture framework to expand the initial dataset while improving the quality of its conversations.
Outcome: The proposed framework expands the initial dataset while improving the quality of its conversations.
Will I Sound Like Me? Improving Persona Consistency in Dialogues through Pragmatic Self-Consciousness (2020.emnlp-main)

Copied to clipboard

Challenge: Existing models for improving consistency often train with additional NLI labels or attach trained extra modules to the generative agent.
Approach: They propose to encode personas into dialogue embeddings and a persona-conditioned dialogue dataset to improve persona consistency.
Outcome: The proposed approach can enforce dialogue agents to refrain from contradictions and improve consistency of existing models.
Reasoning Is Not All You Need: Examining LLMs for Multi-Turn Mental Health Conversations (2026.acl-long)

Copied to clipboard

Challenge: Existing evaluation frameworks focus on diagnostic accuracy and win-rates and often overlook alignment with patient-specific goals, values, and personalities required for meaningful conversations.
Approach: They propose a framework for synthetically generating realistic, multi-turn mental health sensemaking conversations and a dataset to examine their models in healthcare settings.
Outcome: The proposed framework synthesizes a dataset comprising over 2,200 patient–LLM conversations and evaluates them using human-centric criteria.
Review-Instruct: A Review-Driven Multi-Turn Conversations Generation Method for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for generating multi-turn dialogue data struggle to ensure both diversity and quality in instructions.
Approach: They propose a framework that synthesizes multi-turn conversations through an iterative "Ask-Respond-Review" process involving three agent roles: a Candidate, multiple Reviewers, and a Chairman.
Outcome: The proposed framework synthesizes multi-turn conversations through an iterative "Ask-Respond-Review" process involving three agent roles: a Candidate, multiple Reviewers, and a Chairman.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations