Challenge: Experimental results show that different moral perspectives lead to changes in the model’s decision-making during general reasoning, reflected in both responses and internal representations.
Approach: They define distinct moral stages based on Kohlberg’s theory of moral development and design prompts to elicit model responses aligned with each condition.
Outcome: The proposed model responses are validated using the Defining Issues Test, a human evaluation tool.

Similar Papers

Diagnosing Moral Reasoning Acquisition in Language Models: Pragmatics and Generalization (2025.findings-emnlp)

Copied to clipboard

Challenge: Prior research has shown that LLMs fail to perform satisfactorily on moral cognizance tasks .
Approach: They propose to use curated datasets to improve LLMs' moral cognizance . they find pragmatic dilemma constrains generalization ability of current learning paradigms .
Outcome: The proposed learning paradigms fail to perform on moral cognizance tasks, the authors show . they show that the pragmatic dilemma is the primary bottleneck for moral reasoning acquisition .
Moral Foundations of Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Moral foundations theory (MFT) is a psychological assessment tool that decomposes human moral reasoning into five factors, including care/harm, liberty/oppression, and sanctity/degradation.
Approach: They propose to use moral foundations theory to analyze whether popular LLMs have acquired a bias towards a particular set of moral values.
Outcome: The proposed model can be adversarially selected to exhibit a particular moral foundations and can affect downstream tasks.
Machine Behavior in Relational Moral Dilemmas: Moral Rightness, Predicted Human Behavior, and Model Decisions (2026.findings-acl)

Copied to clipboard

Challenge: Human moral judgment is context-dependent and changes based on interpersonal relationships.
Approach: They characterize LLM behavior using the Whistleblower’s Dilemma . they find moral rightness remains consistently fairness-oriented .
Outcome: The model decisions mirror moral rightness judgments, rather than their behavioral predictions.
Why Are We Moral? An LLM-based Agent Simulation Approach to the Study of Moral Evolution (2026.acl-long)

Copied to clipboard

Challenge: Existing models of moral evolution must abstract away cognitive processes . et al. (2017): evolution of morality presents a puzzle: natural selection favors selfish .
Approach: They propose an LLM-based agent simulation framework that manipulates cognitive factors to understand moral evolution.
Outcome: The proposed model exploits cognitive realism to explore moral evolution in a hunter-gatherer society.
Do Moral Judgment and Reasoning Capability of LLMs Change with Language? A Study using the Multilingual Defining Issues Test (2024.eacl-long)

Copied to clipboard

Challenge: Existing studies have shown that moral judgment depends on the language in which the dilemma is presented.
Approach: They extend the work of beyond English, to 5 new languages (Chinese, Hindi, Russian, Spanish and Swahili) and probe three LLMs that show substantial multilingual text processing and generation abilities.
Outcome: The models show substantial multilingual text processing and generation abilities.
Adaptable Moral Stances of Large Language Models on Sexist Content: Implications for Society and Gender Discourse (2024.emnlp-main)

Copied to clipboard

Challenge: Using large language models, large language model learning has become more integrated into our daily lives, making it increasingly important to ensure they reflect ethical and equitable values.
Approach: They assess how LLMs can apply moral reasoning to both criticize and defend sexist language by evaluating their models and evaluating the moral foundations cited by them.
Outcome: The models show they can provide comprehensible and contextually relevant text for understanding diverse views on how sexism is perceived.
Rethinking Machine Ethics – Can LLMs Perform Moral Reasoning through the Lens of Moral Theories? (2024.findings-naacl)

Copied to clipboard

Challenge: Existing approaches to making moral judgments are mostly bottom-up and lack explainability.
Approach: They propose a top-down framework to steer Large Language Models to perform moral reasoning with well-established moral theories.
Outcome: The proposed framework can integrate various moral theories on moral datasets.
The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmas (2025.emnlp-main)

Copied to clipboard

Challenge: Existing evaluations of LLMs' moral reasoning capabilities rely on single-step evaluations, ignoring how models adapt to evolving ethical challenges.
Approach: They propose a framework to evaluate evolving moral judgments of large language models (LLMs) using multi-step moral dilemma questionnaires.
Outcome: The proposed framework enables a fine-grained analysis of how LLMs adjust their moral reasoning across escalating dilemmas.
Ethical Reasoning and Moral Value Alignment of LLMs Depend on the Language We Prompt Them in (2024.lrec-main)

Copied to clipboard

Challenge: Ethical reasoning is a crucial skill for Large Language Models (LLMs). However, moral values are not universal, but rather influenced by language and culture.
Approach: They extend the study of ethical reasoning of LLMs by (CITATION) to a multilingual setup using six languages: English, Spanish, Russian, Chinese, Hindi, and Swahili.
Outcome: The proposed model is based on a multilingual setup in English, Spanish, Russian, Chinese, Hindi, and Swahili.
Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMs (2023.findings-emnlp)

Copied to clipboard

Challenge: a paper by a team of researchers proposes that large language models should be morally aligned to ethical principles . a moral compass is a model that integrates moral dilemmas with moral principles pertaining to different foramlisms of normative ethics .
Approach: They propose to infuse generic ethical reasoning capabilities into large-scale models . they argue that LLMs should take a moral stance on value pluralism .
Outcome: a new ethical reasoning framework integrates moral dilemmas with moral principles . the framework is based on the results of a hypothetical case study on a large-scale model .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations