Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing literature on leveraging persona in large language models is disorganized and lacks a systematic taxonomy . leveraging peopleas has resurfaced as an ideal lens for adapting LLMs for specific contexts . |
| Approach: | They propose to categorize current research on leveraging persona in large language models . they propose to use a comprehensive survey to categorize existing studies . |
| Outcome: | The proposed framework is a promising framework for tailoring large language models to specific contexts. |
Similar Papers
Modeling, Evaluating, and Embodying Personality in LLMs: A Survey (2025.findings-emnlp)
Copied to clipboard
Iago Alves Brito, Julia Soares Dollis, Fernanda Bufon Färber, Pedro Schindler Freire Brasil Ribeiro, Rafael Teixeira Sousa, Arlindo Rodrigues Galvão Filho
| Challenge: | This survey provides a comprehensive overview of the LLM-driven personality scenario. |
| Approach: | This survey provides a comprehensive overview of the LLM-driven personality scenario. |
| Outcome: | The proposed taxonomy analyzes the limitations of existing methods and identifies key research gaps. |
Can LLM be a Personalized Judge? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a new study examines the reliability of large language models (LLMs) for personalization and role-playing evaluation without examining its validity. |
| Approach: | They investigate the reliability of LLM-as-a-Personalized-Judge for personalization . they find that personas provided to LLMs have limited predictive power . |
| Outcome: | The proposed model is less reliable than previously thought, the authors show . human annotation reveals that third-person crowd worker evaluations of personalized preferences are even worse than LLM predictions. |
PersonaGym: Evaluating Persona Agents and LLMs (2025.findings-emnlp)
Copied to clipboard
Vinay Samuel, Henry Peng Zou, Yue Zhou, Shreyas Chaudhari, Ashwin Kalyan, Tanmay Rajpurohit, Ameet Deshpande, Karthik R Narasimhan, Vishvak Murahari
| Challenge: | Persona agents are LLM agents conditioned to act according to an assigned persona . evaluating how faithfully these agents adhere to their personas remains a challenge . |
| Approach: | a new study evaluates persona agents' ability to act according to an assigned persona . a persona agent's person score is a human-aligned automatic metric that can be used to evaluate a model . |
| Outcome: | a new evaluation framework and a human-aligned automatic metric show that persona agents can perform better. |
A Survey on LLMs for Story Generation (2025.findings-emnlp)
Copied to clipboard
Maria Teleki, Vedangi Bengali, Xiangjue Dong, Sai Tejas Janjur, Haoran Liu, Tian Liu, Cong Wang, Ting Liu, Yin Zhang, Frank Shipman, James Caverlee
| Challenge: | Methods for story generation with Large Language Models (LLMs) have come into the spotlight recently. |
| Approach: | They propose a novel taxonomy of LLMs for story generation consisting of two major paradigms: independent story generation by an LLM, and author-assistance for story creation . |
| Outcome: | The proposed taxonomy compares existing work on the topic with those of novel author-assistance models. |
One Persona, Many Cues, Different Results: How Sociodemographic Cues Impact LLM Personalization (2026.acl-long)
Copied to clipboard
| Challenge: | Prior work has used personas to study biases by relying on a single cue to prompt a persona, such as user names or explicit attribute mentions. |
| Approach: | They compare six commonly used personacues across seven open and proprietary LLMs on four writing and advice tasks. |
| Outcome: | The proposed model is based on a persona, a synthetic user profile defined by specific attributes, defined by gender or race. |
An Empirical Analysis of the Writing Styles of Persona-Assigned LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent efforts to "personalize" large language models by assigning them specific personas are limited by current knowledge of how well they perform. |
| Approach: | They use a style embedding model to analyze writing styles of persona-assigned LLMs . they find significant style differences between personas using Kullback-Leibler divergence . |
| Outcome: | The proposed model shows significant differences in writing styles among personas across socio-demographic groups. |
Character is Destiny: Can Persona-assigned Language Models Make Personal Choices? (2025.findings-emnlp)
Copied to clipboard
Rui Xu, Xintao Wang, Jiangjie Chen, Siyu Yuan, Xinfeng Yuan, Jiaqing Liang, Zulong Chen, null Xiaoqingdong, Yanghua Xiao
| Challenge: | Recent research has demonstrated the potential of using LLMs to develop role-playing language agents (RPLAs) however, imitative decision-making necessitates a more nuanced understanding of personas. |
| Approach: | They propose a method that uses persona-based memory retrieval to improve RPLAs. |
| Outcome: | The proposed method significantly advances RPLAs on this task. |
Can Role Vectors Affect LLM Behaviour? (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study has shown that personas influence LLM performance, but their direct impact remains unclear. |
| Approach: | They propose a novel approach to guiding LLM behaviour through role vectors . they construct 29 role vector derived from model activations and evaluate their impact . |
| Outcome: | The proposed approach improves in-domain task performance while yielding unexpected gains. |
From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge (2025.emnlp-main)
Copied to clipboard
Dawei Li, Bohan Jiang, Liangjie Huang, Alimohammad Beigi, Chengshuai Zhao, Zhen Tan, Amrita Bhattacharjee, Yuxuan Jiang, Canyu Chen, Tianhao Wu, Kai Shu, Lu Cheng, Huan Liu
| Challenge: | Recent advances in Large Language Models (LLMs) inspire the "LLM-as-a-judge" paradigm . traditional methods of assessment and evaluation fail in dynamic and open-ended scenarios . |
| Approach: | They propose a paradigm where LLMs are leveraged to perform scoring, ranking, or selection for machine learning evaluation scenarios. |
| Outcome: | The proposed model-based judgment and evaluation paradigms are based on large language models and are compared to the current model-driven evaluation paradigm. |
LLMs + Persona-Plug = Personalized LLMs (2025.acl-long)
Copied to clipboard
Jiongnan Liu, Yutao Zhu, Shuting Wang, Xiaochi Wei, Erxue Min, Yu Lu, Shuaiqiang Wang, Dawei Yin, Zhicheng Dou
| Challenge: | Large language models (LLMs) have demonstrated extraordinary capabilities in natural language understanding, generation, and reasoning. |
| Approach: | They propose a plug-and-play LLM model that embeds a user-specific embedding for each individual by modeling her historical contexts through a lightweight plug-in user embedder module. |
| Outcome: | Experiments on various tasks in the language model personalization (LaMP) benchmark show that the proposed model significantly outperforms existing personalized LLM approaches. |