ExpertIVS: Sociological Expert Driven Individual Value Simulation in Large Language Models (2026.findings-acl)
Copied to clipboard
Zhen Wang, Yuqi Ren, Yuehan Cui, Hongxiang Wang, Jianxiang Peng, Zhaoxia Zhang, Bingkun Zhu, Tongxuan Zhang, Dezhi Tong, Deyi Xiong
| Challenge: | Existing methods for social simulations mechanically stitch survey responses into prompts, which suffer from semantic fragmentation, failing to capture the internal coherence of human value systems. |
| Approach: | They propose a framework employing 14 Sociological Expert Agents to interpret World Values Survey responses through structured professional perspectives rather than direct responses concatenation. |
| Outcome: | Experiments on 480 individuals from 12 countries show that ExpertIVS outperforms baselines in value generalization and significantly outperfies the existing methods. |
Similar Papers
The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models (2024.findings-emnlp)
Copied to clipboard
Bolei Ma, Xinpeng Wang, Tiancheng Hu, Anna-Carolina Haensch, Michael Hedderich, Barbara Plank, Frauke Kreuter
| Challenge: | Recent advances in Large Language Models have sparked interest in validating human-like cognitive-behavioral traits. |
| Approach: | They examine whether LLM outputs reflect human-like cognitive-behavioral traits . they find that measuring AOVs embedded within LLMs remains opaque . |
| Outcome: | The proposed model can be used to evaluate human-like cognitive-behavioral traits . the proposed model could be used in writing assistants and other applications . |
Context-Value-Action Architecture for Value-Driven Large Language Model Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing LLMs exhibit behavioral rigidity, a flaw often masked by the self-referential bias of current "LLM-as-a-judge" evaluations. |
| Approach: | They propose a Context-Value-Action architecture that decouples action generation from cognitive reasoning via a Value Verifier trained on authentic human data to explicitly model dynamic value activation. |
| Outcome: | The proposed architecture significantly outperforms baseline models on 1.1 million real-world interaction traces on CVABench. |
ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are transforming diverse fields and gaining increasing influence as human proxies. |
| Approach: | They propose a psychometric evaluation pipeline grounded in realistic human-AI interactions to probe value orientations and novel tasks for evaluating value understanding in an open-ended value space. |
| Outcome: | The proposed evaluation pipeline is grounded in realistic human-AI interactions and performs tasks that approximate expert conclusions in value-related extraction and generation tasks. |
Beyond Demographics: Enhancing Cultural Value Survey Simulation with Multi-Stage Personality-Driven Cognitive Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Introducing **MARK**, a framework for cultural value survey simulation . based on type dynamics theory, it improves accuracy and interpretation of models . |
| Approach: | They propose a framework that integrates psychological theory into cultural value survey simulations. |
| Outcome: | The proposed framework outperforms baseline models on the World Values Survey by 10% accuracy and reduces divergence between model predictions and human preferences. |
Systematic Biases in LLM Simulations of Debates (2024.emnlp-main)
Copied to clipboard
| Challenge: | Current research suggests that LLM-based agents become increasingly human-like in their performance, sparking interest in using these AI agents as substitutes for human participants in behavioral studies. |
| Approach: | They propose to use LLMs to simulate political debates on topics that are important aspects of people’s day-to-day lives and decision-making processes. |
| Outcome: | The proposed model can simulate political debates on topics that are important aspects of people’s day-to-day lives and decision-making processes. |
Do LLMs Align Human Values Regarding Social Biases? Judging and Explaining Social Biases with LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models can lead to undesired consequences when misaligned with human values . previous studies have shown misalignment of LLMs with human value using expert-designed or agent-based emulated bias scenarios . |
| Approach: | They investigate whether large language models (LLMs) are misaligned with human values . they find no significant differences in understanding of HVSB between LLMs . |
| Outcome: | The results show that large language models do not have lower misalignment rates and attack success rates . the study also shows that smaller language models have the ability to explain HVSB . |
A Survey on LLM-powered Agents for Recommender Systems (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models have demonstrated remarkable capabilities in natural language understanding, reasoning, and generation. |
| Approach: | They present a comprehensive synthesis of large language models and their applications . they dissect a four-module agent architecture and review representative designs . |
| Outcome: | The proposed models address fundamental challenges in traditional recommender systems . they include limited comprehension of complex user intents, insufficient interaction capabilities . |
Simulating Opinion Dynamics with Networks of LLM-based Agents (2024.findings-naacl)
Copied to clipboard
Yun-Shiuan Chuang, Agam Goyal, Nikunj Harlalka, Siddharth Suresh, Robert Hawkins, Sijia Yang, Dhavan Shah, Junjie Hu, Timothy Rogers
| Challenge: | Existing approaches to simulating opinion dynamics often over-simplify human behavior . authors propose refining LLMs with real-world discourse to better simulate evolution of beliefs . |
| Approach: | They propose to use large language models to simulate opinion dynamics in groups of simulated agents . they found that LLM agents produce more accurate information than ABMs . |
| Outcome: | The proposed model can be used to better simulate opinion dynamics in real-world discourses. |
LLM Tropes: Revealing Fine-Grained Values and Opinions in Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to evaluate latent values and opinions in large language models suffer from three notable shortcomings. |
| Approach: | They propose to analyze 156k LLM responses to 62 propositions of the Political Compass Test (PCT) generated by 6 LLMs using 420 prompt variations. |
| Outcome: | The proposed analysis of 156k LLM responses to the Political Compass Test (PCT) generated by 6 LLMs shows that tropes are recurrent and consistent across prompts. |
Modeling, Evaluating, and Embodying Personality in LLMs: A Survey (2025.findings-emnlp)
Copied to clipboard
Iago Alves Brito, Julia Soares Dollis, Fernanda Bufon Färber, Pedro Schindler Freire Brasil Ribeiro, Rafael Teixeira Sousa, Arlindo Rodrigues Galvão Filho
| Challenge: | This survey provides a comprehensive overview of the LLM-driven personality scenario. |
| Approach: | This survey provides a comprehensive overview of the LLM-driven personality scenario. |
| Outcome: | The proposed taxonomy analyzes the limitations of existing methods and identifies key research gaps. |