Why Are We Moral? An LLM-based Agent Simulation Approach to the Study of Moral Evolution (2026.acl-long)
Copied to clipboard
Zhou Ziheng, Huacong Tang, Mingjie Bi, Wanying He, Fang Sun, Yizhou Sun, Ying Nian Wu, Demetri Terzopoulos, Yipeng Kang, Fangwei Zhong
| Challenge: | Existing models of moral evolution must abstract away cognitive processes . et al. (2017): evolution of morality presents a puzzle: natural selection favors selfish . |
| Approach: | They propose an LLM-based agent simulation framework that manipulates cognitive factors to understand moral evolution. |
| Outcome: | The proposed model exploits cognitive realism to explore moral evolution in a hunter-gatherer society. |
Similar Papers
How do Role Models Shape Collective Morality? Exemplar-Driven Moral Learning in Multi-Agent Simulation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies show that role models influence morality, but they are not uniformly interpreted and appropriated in groups with heterogeneous motivations. |
| Approach: | They build a multi-agent simulation where agents with diverse intrinsic drives interact and adapt through a four-stage cognitive loop. |
| Outcome: | The proposed model can significantly reshape morality of agents with diverse intrinsic drives . the simulations show that identity-driven conformity can substantially reshaped initial dispositions . |
Do Morals Guide How LLMs Think? The Role of Ethical Perspectives in General Problem Solving (2026.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that different moral perspectives lead to changes in the model’s decision-making during general reasoning, reflected in both responses and internal representations. |
| Approach: | They define distinct moral stages based on Kohlberg’s theory of moral development and design prompts to elicit model responses aligned with each condition. |
| Outcome: | The proposed model responses are validated using the Defining Issues Test, a human evaluation tool. |
Rethinking Machine Ethics – Can LLMs Perform Moral Reasoning through the Lens of Moral Theories? (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to making moral judgments are mostly bottom-up and lack explainability. |
| Approach: | They propose a top-down framework to steer Large Language Models to perform moral reasoning with well-established moral theories. |
| Outcome: | The proposed framework can integrate various moral theories on moral datasets. |
Dynamic Personality in LLM Agents: A Framework for Evolutionary Modeling and Behavioral Analysis in the Prisoner’s Dilemma (2025.findings-acl)
Copied to clipboard
| Challenge: | Current models rely on static personality traits but lack natural selection processes and direct psychological metrics, failing to accurately capture authentic dynamic personality variations. |
| Approach: | They propose a framework that uses game payoffs as environmental feedback to drive adaptive personality evolution and analyze correlations between personality metrics and behavior. |
| Outcome: | The proposed framework reveals new behavioral patterns of agents and evaluates personality-behavior relationships, advancing agent-based social simulations and human-AI symbiosis research. |
Tales of Morality: Comparing Human- and LLM-Generated Moral Stories from Visual Cues (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study has found that stories are central to how humans communicate moral values . |
| Approach: | They compare human- and LLM-generated moral narratives based on images annotated by humans for moral content . authors propose a framework for evaluating moral storytelling in vision-language models . |
| Outcome: | The proposed model compared human- and LLM-generated narratives on images . human stories reflect a balanced distribution of moral foundations and coherent narrative arcs, but LLMs emphasize Care foundation and lack emotional resolution. |
Systematic Biases in LLM Simulations of Debates (2024.emnlp-main)
Copied to clipboard
| Challenge: | Current research suggests that LLM-based agents become increasingly human-like in their performance, sparking interest in using these AI agents as substitutes for human participants in behavioral studies. |
| Approach: | They propose to use LLMs to simulate political debates on topics that are important aspects of people’s day-to-day lives and decision-making processes. |
| Outcome: | The proposed model can simulate political debates on topics that are important aspects of people’s day-to-day lives and decision-making processes. |
Comparing Moral Values in Western English-speaking societies and LLMs with Word Associations (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are trained on extensive corpora to learn linguistic patterns, contextual nuances, and implicit elements of human values. |
| Approach: | They propose to use word associations as low-level underlying representations to obtain a more robust picture of LLMs’ moral reasoning. |
| Outcome: | The proposed method reveals detailed but systematic differences between LLMs and human associations. |
Diagnosing Moral Reasoning Acquisition in Language Models: Pragmatics and Generalization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Prior research has shown that LLMs fail to perform satisfactorily on moral cognizance tasks . |
| Approach: | They propose to use curated datasets to improve LLMs' moral cognizance . they find pragmatic dilemma constrains generalization ability of current learning paradigms . |
| Outcome: | The proposed learning paradigms fail to perform on moral cognizance tasks, the authors show . they show that the pragmatic dilemma is the primary bottleneck for moral reasoning acquisition . |
Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMs (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a paper by a team of researchers proposes that large language models should be morally aligned to ethical principles . a moral compass is a model that integrates moral dilemmas with moral principles pertaining to different foramlisms of normative ethics . |
| Approach: | They propose to infuse generic ethical reasoning capabilities into large-scale models . they argue that LLMs should take a moral stance on value pluralism . |
| Outcome: | a new ethical reasoning framework integrates moral dilemmas with moral principles . the framework is based on the results of a hypothetical case study on a large-scale model . |
Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation Framework (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly deployed in domains requiring moral understanding, yet their reasoning often remains shallow and misaligned with human reasoning. |
| Approach: | They propose a value-grounded framework for evaluating and distilling structured moral reasoning in large language models. |
| Outcome: | The proposed framework evaluates 12 open-source models across four moral datasets. |