Challenge: Large Language Models exhibit a progressive left-leaning bias, but can also produce behavior that aligns with socioeconomic groups.
Approach: They analyze whether persona prompting can accurately predict individual voting decisions . they find that they can simulate the voting behavior of European Parliament members reasonably well .
Outcome: The proposed model can predict the voting behavior of European Parliament members reasonably well, with a weighted F1 score of approximately 0.793.

Similar Papers

Algorithmic Fidelity of Large Language Models in Generating Synthetic German Public Opinions: A Case Study (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models have generated significant interest in their potential for synthetic data generation across various domains.
Approach: They use open-ended survey data from the German Longitudinal Election Studies to prompt different LLMs to generate synthetic public opinions reflective of German subpopulations by incorporating demographic features into the persona prompts.
Outcome: The LLM performs better for supporters of left-leaning parties like The Greens and The Left compared to other parties, and matches the least with the right-party AfD.
The Prompt Makes the Person(a): A Systematic Evaluation of Sociodemographic Persona Prompting for Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: persona prompting is increasingly used in large language models to simulate views of various sociodemographic groups.
Approach: They use open-source LLMs to study how persona prompts influence LLM simulations . they use role adoption formats and demographic priming strategies to study marginalized groups .
Outcome: The results show that the choice of demographic priming and role adoption strategy significantly impacts their portrayal.
Quantifying the Persona Effect in LLM Simulations (2024.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have shown remarkable promise in simulating human language and behavior.
Approach: They investigate how integrating persona variables—demographic, social, and behavioral factors—impacts LLMs’ ability to simulate diverse perspectives.
Outcome: The proposed model improves on a zero-shot model with persona prompting.
Llama meets EU: Investigating the European political spectrum through the lens of LLMs (2024.naacl-short)

Copied to clipboard

Challenge: Large Language Models inherit clear political leanings that have been shown to influence downstream task performance.
Approach: They adapt Llama Chat to a European political context and audit its political leanings based on the EUandI questionnaire to analyze its political knowledge and ability to reason in context.
Outcome: The proposed model is adapted from speeches of individual euro-parties from debates in the European Parliament to analyze its political leanings.
PERSONA: A Reproducible Testbed for Pluralistic Alignment (2025.coling-main)

Copied to clipboard

Challenge: Currently, preference optimization approaches fail to capture the plurality of user opinions . Currently used methods do not account for the pluralities of users and difference of opinion .
Approach: They propose a reproducible test bed to evaluate pluralistic alignment of language models . they generate user profiles from census data and use a large-scale evaluation dataset .
Outcome: The proposed model improves pluralistic alignment of language models with diverse user values . it generates a large-scale evaluation dataset with 317,200 feedback pairs .
Persona Prompting as a Lens on LLM Social Reasoning (2026.eacl-long)

Copied to clipboard

Challenge: Persona prompting (PP) is increasingly used to steer large language models towards user-specific generation, but its effect on rationales remains underexplored.
Approach: They examine how LLM-generated rationales vary when conditioned on different demographic personas . they use word-level rationale annotations to measure agreement with human annotations based on PP .
Outcome: The proposed model improves classification on the most subjective task, but fails to align with real-world demographic counterparts.
Aligning Large Language Models with Diverse Political Viewpoints (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models such as ChatGPT exhibit striking political biases . a recent study shows that chatbots exhibit progressive, liberal, and proenvironmental biase .
Approach: They propose to align large language models with 100,000 comments from candidates running for national parliament in Switzerland.
Outcome: The proposed model generates more accurate political viewpoints from Swiss parties compared to commercial models such as ChatGPT.
OPeRA: A Dataset of Observation, Persona, Rationale, and Action for Evaluating LLMs on Human Online Shopping Behavior Simulation (2026.acl-long)

Copied to clipboard

Challenge: evaluating LLMs' ability to mimic real user behavior remains an open challenge due to the lack of high-quality, publicly available datasets that capture both the observable actions and the internal reasoning of an actual user.
Approach: They propose a dataset of Observation, Persona, Rationale, and Action collected from real human participants during online shopping sessions.
Outcome: The proposed dataset is the first to evaluate how well current LLMs can accurately simulate the next web action of a specific user.
Evaluating Large Language Model Biases in Persona-Steered Generation (2024.findings-acl)

Copied to clipboard

Challenge: a recent wave of powerful new large language models has raised concerns that their expressed opinions may be biased towards certain political, national or moral viewpoints.
Approach: They define an incongruous persona as a persona with multiple traits where one trait makes its other traits less likely in human survey data.
Outcome: The results show that LLMs are less steerable towards incongruous personas than congruous ones . the models that are fine-tuned with RLHF are more steerable, especially towards stances associated with political liberals and women .
Persona-Assigned Large Language Models Exhibit Human-Like Motivated Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Prior studies have reported that large language models (LLMs) are also susceptible to human-like cognitive biases, but the extent to which LLMs selectively reason toward identity-congruent conclusions remains unexplored.
Approach: They investigate whether assigning 8 personas across 4 political and socio-demographic attributes induces motivated reasoning in LLMs.
Outcome: The proposed model is assigned 8 personas across 4 political and socio-demographic attributes and shows that they have 9% reduced veracity discernment compared to models without persona.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations