Rethinking Machine Ethics – Can LLMs Perform Moral Reasoning through the Lens of Moral Theories? (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to making moral judgments are mostly bottom-up and lack explainability. |
| Approach: | They propose a top-down framework to steer Large Language Models to perform moral reasoning with well-established moral theories. |
| Outcome: | The proposed framework can integrate various moral theories on moral datasets. |
Similar Papers
Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation Framework (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly deployed in domains requiring moral understanding, yet their reasoning often remains shallow and misaligned with human reasoning. |
| Approach: | They propose a value-grounded framework for evaluating and distilling structured moral reasoning in large language models. |
| Outcome: | The proposed framework evaluates 12 open-source models across four moral datasets. |
Are Language Models Consequentialist or Deontological Moral Reasoners? (2025.emnlp-main)
Copied to clipboard
Keenan Samway, Max Kleiman-Weiner, David Guzman Piedrahita, Rada Mihalcea, Bernhard Schölkopf, Zhijing Jin
| Challenge: | Recent studies have focused on the moral judgments in large language models rather than their underlying moral reasoning process. |
| Approach: | They propose a taxonomy of moral rationales to classify reasoning traces according to consequentialism and deontology . they use trolley problems to analyze moral reasoning tracing in large language models . |
| Outcome: | The proposed taxonomy of moral rationales sheds light on consequentialism and deontology . it systematically classifies reasoning traces according to two main ethical theories . |
On the Machine Learning of Ethical Judgments from Natural Language (2022.naacl-main)
Copied to clipboard
| Challenge: | a recent study examines the morality of NLP models that can take in arbitrary text and output a moral judgment . a Delphi project is a popular system for moral prediction, but it has received criticism . |
| Approach: | They propose to critique NLP methods for automating ethical decision-making . they examine a nascent task of predicting moral and ethical decisions from text . |
| Outcome: | The proposed model is unsafe at any accuracy, the authors argue . they argue that the proposed model could be useful in NLP, but not in AI. |
Evaluating Moral Beliefs across LLMs through a Pluralistic Framework (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Proper moral beliefs are fundamental for language models, yet assessing these beliefs poses a significant challenge. |
| Approach: | They propose a framework to evaluate the moral beliefs of four large language models . they use a dataset containing 472 moral choice scenarios in Chinese . |
| Outcome: | The proposed framework evaluates the moral beliefs of four large language models. |
Probabilistic Aggregation and Targeted Embedding Optimization for Collective Moral Reasoning in Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have impressive moral reasoning abilities, yet they often diverge when confronted with complex, multi-factor moral dilemmas. |
| Approach: | They propose a framework that synthesizes multiple LLMs’ moral judgments into a collectively formulated moral judgment, realigning models that deviate significantly from this consensus. |
| Outcome: | The proposed framework synthesizes multiple LLMs’ moral judgments into a collectively formulated moral judgment, realigning models that deviate significantly from this consensus. |
Diagnosing Moral Reasoning Acquisition in Language Models: Pragmatics and Generalization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Prior research has shown that LLMs fail to perform satisfactorily on moral cognizance tasks . |
| Approach: | They propose to use curated datasets to improve LLMs' moral cognizance . they find pragmatic dilemma constrains generalization ability of current learning paradigms . |
| Outcome: | The proposed learning paradigms fail to perform on moral cognizance tasks, the authors show . they show that the pragmatic dilemma is the primary bottleneck for moral reasoning acquisition . |
The Only Way is Ethics: A Guide to Ethical Research with Large Language Models (2025.coling-main)
Copied to clipboard
Eddie L. Ungless, Nikolas Vitsakis, Zeerak Talat, James Garforth, Bjorn Ross, Arno Onken, Atoosa Kasirzadeh, Alexandra Birch
| Challenge: | Existing literature on the ethical aspects of large language models (LLMs) is lacking a single practical guide on the subject. |
| Approach: | They propose to translate ethics literature into concrete recommendations for computer scientists by presenting an open and living resource for NLP practitioners and those tasked with evaluating the ethical implications of others’ work. |
| Outcome: | The proposed guide is an open and living resource for NLP practitioners and those tasked with evaluating the ethical implications of others’ work. |
Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMs (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a paper by a team of researchers proposes that large language models should be morally aligned to ethical principles . a moral compass is a model that integrates moral dilemmas with moral principles pertaining to different foramlisms of normative ethics . |
| Approach: | They propose to infuse generic ethical reasoning capabilities into large-scale models . they argue that LLMs should take a moral stance on value pluralism . |
| Outcome: | a new ethical reasoning framework integrates moral dilemmas with moral principles . the framework is based on the results of a hypothetical case study on a large-scale model . |
Adaptable Moral Stances of Large Language Models on Sexist Content: Implications for Society and Gender Discourse (2024.emnlp-main)
Copied to clipboard
| Challenge: | Using large language models, large language model learning has become more integrated into our daily lives, making it increasingly important to ensure they reflect ethical and equitable values. |
| Approach: | They assess how LLMs can apply moral reasoning to both criticize and defend sexist language by evaluating their models and evaluating the moral foundations cited by them. |
| Outcome: | The models show they can provide comprehensible and contextually relevant text for understanding diverse views on how sexism is perceived. |
Do Morals Guide How LLMs Think? The Role of Ethical Perspectives in General Problem Solving (2026.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that different moral perspectives lead to changes in the model’s decision-making during general reasoning, reflected in both responses and internal representations. |
| Approach: | They define distinct moral stages based on Kohlberg’s theory of moral development and design prompts to elicit model responses aligned with each condition. |
| Outcome: | The proposed model responses are validated using the Defining Issues Test, a human evaluation tool. |