Is He Extroverted? Identifying Missing Relevant Personas for Faithful User Simulation (2026.eacl-srw)
Copied to clipboard
| Challenge: | Existing user simulation approaches focus on generating user-like responses in dialogue without verifying whether critical personas are supplied. |
| Approach: | They propose a task of identifying persona dimensions that are relevant but missing in simulating a user's reply for a given dialogue context. |
| Outcome: | The proposed model identifies persona dimensions that are relevant but missing in simulating a user’s response for a given dialogue context. |
Similar Papers
I Know, but I Don’t Know! How Persona Conflict Undermines Instruction Adherence in Large Language Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing studies on persona-grounded dialogue assume idealized scenarios where persona and user utterances are fully aligned. |
| Approach: | They propose a taxonomy that categorizes model behaviors into three response types . they propose sycophantic, adherent, and wavering responses as response types. |
| Outcome: | The proposed framework categorizes model behaviors into three response types and develops a measurement schema grounded in this taxonomy. |
(CPER) From Guessing to Asking: An Approach to Resolving Persona Knowledge Gap in LLMs during Multi-Turn Conversations (2025.naacl-srw)
Copied to clipboard
| Challenge: | Existing methods for identifying and resolving persona knowledge gaps are underexplored. |
| Approach: | They propose a framework that dynamically detects and resolves persona knowledge gaps using intrinsic uncertainty quantification and feedback-driven refinement. |
| Outcome: | The proposed framework detects and resolves persona knowledge gaps using intrinsic uncertainty quantification and feedback-driven refinement on two real-world datasets: CCPE-M for preferential movie recommendations and ESConv for mental health support. |
TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation (2026.findings-acl)
Copied to clipboard
Bangde Du, Minghao Guo, Songming He, Ziyi Ye, Xi Zhu, Weihang Su, Shuqi Zhu, Yujia Zhou, Yongfeng Zhang, Qingyao Ai, Yiqun Liu
| Challenge: | Existing studies show that advanced LLMs produce text indistinguishable from human writing. |
| Approach: | They propose a benchmark to assess persona simulation across diverse contexts by decomposing the evaluation into six fundamental capabilities including opinion consistency, memory recall, logical reasoning, persona tone, and syntactic style. |
| Outcome: | The proposed model achieves moderate accuracy but falls short of the basic capabilities needed to simulate personas in real-world contexts. |
Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing literature on leveraging persona in large language models is disorganized and lacks a systematic taxonomy . leveraging peopleas has resurfaced as an ideal lens for adapting LLMs for specific contexts . |
| Approach: | They propose to categorize current research on leveraging persona in large language models . they propose to use a comprehensive survey to categorize existing studies . |
| Outcome: | The proposed framework is a promising framework for tailoring large language models to specific contexts. |
Query-Focused Individual Simulation with Progressive Persona Completion (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to simulating individual responses from persona information assume rich persona profiles, which are often unavailable in practice. |
| Approach: | They propose a query-focused individual simulation where relevant persona information is identified and requested on demand for each query. |
| Outcome: | Experiments on two dialogue datasets show that the proposed method achieves comparable performance to approaches that rely on rich persona information extracted from dialogue history. |
Spotting Out-of-Character Behavior: Atomic-Level Evaluation of Persona Fidelity in Open-Ended Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation methods struggle to capture subtle inconsistencies in large language models. |
| Approach: | They propose an atomic-level evaluation framework that quantifies persona fidelity at a finer granularity. |
| Outcome: | The proposed framework detects inconsistencies that prior evaluation methods overlook . it captures subtle deviations that real users would encounter . |
Beyond Fixed Psychological Personas: State Beats Trait, but Language Models are State-Blind (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing persona datasets capture only trait, and ignore impact of state. |
| Approach: | They use a Reddit dataset to study user interactions with language models . they find that existing persona datasets capture only trait and ignore impact of state . |
| Outcome: | The proposed dataset decomposes variance and finds that LLMs are state-blind . the reward models react to user state, but inconsistently, the authors say . |
PersonaGym: Evaluating Persona Agents and LLMs (2025.findings-emnlp)
Copied to clipboard
Vinay Samuel, Henry Peng Zou, Yue Zhou, Shreyas Chaudhari, Ashwin Kalyan, Tanmay Rajpurohit, Ameet Deshpande, Karthik R Narasimhan, Vishvak Murahari
| Challenge: | Persona agents are LLM agents conditioned to act according to an assigned persona . evaluating how faithfully these agents adhere to their personas remains a challenge . |
| Approach: | a new study evaluates persona agents' ability to act according to an assigned persona . a persona agent's person score is a human-aligned automatic metric that can be used to evaluate a model . |
| Outcome: | a new evaluation framework and a human-aligned automatic metric show that persona agents can perform better. |
Beyond Profile: From Surface-Level Facts to Deep Persona Simulation in LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to persona simulation large language models (LLMs) focus on learning basic biographical information, or using limited role-play dialogue datasets to capture a character’s responses. |
| Approach: | They propose to train characters using a linguistic structure and a style-tuning mechanism that allows a general linguistic style expert to collaborate with other task-specific experts to better understand their thoughts. |
| Outcome: | The proposed model outperforms baselines on linguistic accuracy and opinion comprehension on three tasks for Lu Xun's essay collection. |
DEEPER Insight into Your User: Directed Persona Refinement for Dynamic Persona Modeling (2025.acl-long)
Copied to clipboard
Aili Chen, Chengyu Du, Jiangjie Chen, Jinghan Xu, Yikai Zhang, Siyu Yuan, Zulong Chen, Liangyue Li, Yanghua Xiao
| Challenge: | Existing methods for generating personas from static historical data fail to capture dynamic behaviors and evolving preferences in real-world interactive scenarios. |
| Approach: | They propose a novel approach that iteratively updates personas using streaming user behavior data to continually enhance their quality. |
| Outcome: | The proposed approach delivers 32.2% reduction in user behavior prediction error over four update rounds, outperforming the best baseline by 22.92%. |