Ethical Reasoning and Moral Value Alignment of LLMs Depend on the Language We Prompt Them in (2024.lrec-main)
Copied to clipboard
| Challenge: | Ethical reasoning is a crucial skill for Large Language Models (LLMs). However, moral values are not universal, but rather influenced by language and culture. |
| Approach: | They extend the study of ethical reasoning of LLMs by (CITATION) to a multilingual setup using six languages: English, Spanish, Russian, Chinese, Hindi, and Swahili. |
| Outcome: | The proposed model is based on a multilingual setup in English, Spanish, Russian, Chinese, Hindi, and Swahili. |
Similar Papers
Do Moral Judgment and Reasoning Capability of LLMs Change with Language? A Study using the Multilingual Defining Issues Test (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing studies have shown that moral judgment depends on the language in which the dilemma is presented. |
| Approach: | They extend the work of beyond English, to 5 new languages (Chinese, Hindi, Russian, Spanish and Swahili) and probe three LLMs that show substantial multilingual text processing and generation abilities. |
| Outcome: | The models show substantial multilingual text processing and generation abilities. |
Ethical Reasoning over Moral Alignment: A Case and Framework for In-Context Ethical Policies in LLMs (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a paper by a team of researchers proposes that large language models should be morally aligned to ethical principles . a moral compass is a model that integrates moral dilemmas with moral principles pertaining to different foramlisms of normative ethics . |
| Approach: | They propose to infuse generic ethical reasoning capabilities into large-scale models . they argue that LLMs should take a moral stance on value pluralism . |
| Outcome: | a new ethical reasoning framework integrates moral dilemmas with moral principles . the framework is based on the results of a hypothetical case study on a large-scale model . |
Are Rules Meant to be Broken? Understanding Multilingual Moral Reasoning as a Computational Pipeline with UniMoral (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to analyze moral reasoning are discordant and lack cohesion, focusing on isolated aspects of the process. |
| Approach: | They propose a unified dataset that integrates moral dilemmas annotated with labels for action choices, ethical principles, contributing factors, and consequences, and captures diverse socio-cultural contexts. |
| Outcome: | The proposed dataset integrates moral dilemmas annotated with labels for action choices, ethical principles, contributing factors, and consequences, along with annotators’ moral and cultural profiles. |
Are Language Models Consequentialist or Deontological Moral Reasoners? (2025.emnlp-main)
Copied to clipboard
Keenan Samway, Max Kleiman-Weiner, David Guzman Piedrahita, Rada Mihalcea, Bernhard Schölkopf, Zhijing Jin
| Challenge: | Recent studies have focused on the moral judgments in large language models rather than their underlying moral reasoning process. |
| Approach: | They propose a taxonomy of moral rationales to classify reasoning traces according to consequentialism and deontology . they use trolley problems to analyze moral reasoning tracing in large language models . |
| Outcome: | The proposed taxonomy of moral rationales sheds light on consequentialism and deontology . it systematically classifies reasoning traces according to two main ethical theories . |
Diagnosing Moral Reasoning Acquisition in Language Models: Pragmatics and Generalization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Prior research has shown that LLMs fail to perform satisfactorily on moral cognizance tasks . |
| Approach: | They propose to use curated datasets to improve LLMs' moral cognizance . they find pragmatic dilemma constrains generalization ability of current learning paradigms . |
| Outcome: | The proposed learning paradigms fail to perform on moral cognizance tasks, the authors show . they show that the pragmatic dilemma is the primary bottleneck for moral reasoning acquisition . |
Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation Framework (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly deployed in domains requiring moral understanding, yet their reasoning often remains shallow and misaligned with human reasoning. |
| Approach: | They propose a value-grounded framework for evaluating and distilling structured moral reasoning in large language models. |
| Outcome: | The proposed framework evaluates 12 open-source models across four moral datasets. |
All Languages Matter: On the Multilingual Safety of LLMs (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing safety benchmarks only concern the safety in one language, e.g. the majority language in the pretraining data such as English. |
| Approach: | They propose a prompting method to improve multilingual safety of ChatGPT by enhancing cross-lingual generalization of safety alignment. |
| Outcome: | The proposed method can significantly reduce the ratio of unsafe responses by 42% for non-English queries. |
MFTCXplain: A Multilingual Benchmark Dataset for Evaluating the Moral Reasoning of LLMs through Multi-hop Hate Speech Explanation (2025.findings-emnlp)
Copied to clipboard
Jackson Trager, Francielle Vargas, Diego Alves, Matteo Guida, Mikel K. Ngueajio, Ameeta Agrawal, Yalda Daryani, Farzan Karimi Malekabadi, Flor Miriam Plaza-del-Arco
| Challenge: | Existing evaluation benchmarks for large language models lack annotations that justify moral classifications and focus on English constrain moral reasoning across diverse cultural settings. |
| Approach: | They propose a multilingual benchmark dataset for evaluating moral reasoning of large language models . it includes 3,000 tweets annotated with binary hate speech labels, moral categories and rationales . |
| Outcome: | The proposed dataset shows a misalignment between LLM outputs and human annotations in moral reasoning tasks. |
The Only Way is Ethics: A Guide to Ethical Research with Large Language Models (2025.coling-main)
Copied to clipboard
Eddie L. Ungless, Nikolas Vitsakis, Zeerak Talat, James Garforth, Bjorn Ross, Arno Onken, Atoosa Kasirzadeh, Alexandra Birch
| Challenge: | Existing literature on the ethical aspects of large language models (LLMs) is lacking a single practical guide on the subject. |
| Approach: | They propose to translate ethics literature into concrete recommendations for computer scientists by presenting an open and living resource for NLP practitioners and those tasked with evaluating the ethical implications of others’ work. |
| Outcome: | The proposed guide is an open and living resource for NLP practitioners and those tasked with evaluating the ethical implications of others’ work. |
HISTOIRESMORALES: A French Dataset for Assessing Moral Alignment (2025.naacl-long)
Copied to clipboard
Thibaud Leteno, Irina Proskurina, Antoine Gourru, Julien Velcin, Charlotte Laclau, Guillaume Metzler, Christophe Gravier
| Challenge: | HistoiresMorales is a dataset based on moralStories in French . it is based upon annotations of moral values within the dataset . |
| Approach: | They propose a dataset in French that aims to align language models with moral values . they use annotations to ensure their alignment with French norms . |
| Outcome: | The proposed dataset guarantees grammatical accuracy and adaptation to the French cultural context. |