Challenge: Existing studies have shown that Large Language Models (LLMs) are not fully aligned with human moral judgments.
Approach: They propose a dataset of 1,618 real-world moral dilemmas paired with a distribution of human moral judgments consisting of a binary evaluation and a free-text rationale to examine how closely LLMs align with human moral judgements.
Outcome: The proposed model reproduces human judgments only under high consensus; alignment deteriorates sharply when human disagreement increases.

Similar Papers

Can Language Models Reason about Individualistic Human Values and Preferences? (2025.acl-long)

Copied to clipboard

Challenge: Existing methods and evaluation frameworks for achieving pluralistic alignment are limited by the diversity of people, which is pre-specified and coarsely categorized, papering over individuality.
Approach: They propose to use a dataset transformed from the influential World Values Survey to study language models on the specific challenge of individualistic value reasoning.
Outcome: The proposed model can predict individualistic values with accuracies between 55% and 65%, while a precise description of individualistic value judgments cannot be approximated only via demographic information.
Tales of Morality: Comparing Human- and LLM-Generated Moral Stories from Visual Cues (2025.findings-emnlp)

Copied to clipboard

Challenge: a recent study has found that stories are central to how humans communicate moral values .
Approach: They compare human- and LLM-generated moral narratives based on images annotated by humans for moral content . authors propose a framework for evaluating moral storytelling in vision-language models .
Outcome: The proposed model compared human- and LLM-generated narratives on images . human stories reflect a balanced distribution of moral foundations and coherent narrative arcs, but LLMs emphasize Care foundation and lack emotional resolution.
The Greatest Good Benchmark: Measuring LLMs’ Alignment with Utilitarian Moral Dilemmas (2024.emnlp-main)

Copied to clipboard

Challenge: Our analysis across 15 diverse LLMs reveals consistently encoded moral preferences that diverge from established moral theories and lay population moral standards.
Approach: They propose to evaluate the moral judgments of large language models using utilitarian dilemmas to determine their moral alignment.
Outcome: The findings highlight the ‘artificial moral compass’ of Large Language Models, offering insights into their moral alignment.
Do LLMs Align Human Values Regarding Social Biases? Judging and Explaining Social Biases with LLMs (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models can lead to undesired consequences when misaligned with human values . previous studies have shown misalignment of LLMs with human value using expert-designed or agent-based emulated bias scenarios .
Approach: They investigate whether large language models (LLMs) are misaligned with human values . they find no significant differences in understanding of HVSB between LLMs .
Outcome: The results show that large language models do not have lower misalignment rates and attack success rates . the study also shows that smaller language models have the ability to explain HVSB .
How Inclusively do LMs Perceive Social and Moral Norms? (2025.findings-naacl)

Copied to clipboard

Challenge: Language models (LMs) are used in decision-making systems and as interactive assistants.
Approach: They propose to prompt 11 LMs on rules-of-thumb and compare their outputs with 100 human annotators.
Outcome: The proposed model is compared with 100 human annotators to find out if they are inclusive of diverse human values.
A Survey on Personalized Alignment—The Missing Piece for Large Language Models in Real-World Applications (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their transition to real-world applications reveals a critical limitation: the inability to adapt to individual preferences while maintaining alignment with universal human values.
Approach: They propose a framework that enables LLMs to adapt their behavior within ethical boundaries based on individual preferences.
Outcome: The proposed framework analyzes implementation approaches and evaluates their effectiveness across various scenarios.
Your Mileage May Vary: How Empathy and Demographics Shape Human Preferences in LLM Responses (2025.findings-emnlp)

Copied to clipboard

Challenge: large language models (LLMs) increasingly assist subjective decision-making . prior work uses aggregate human judgments, but demographic variation and its linguistic drivers remain underexplored.
Approach: They analyze how demographic background and empathy level correlate with LLM-generated dilemma responses . they also identify markers that predict group-level differences .
Outcome: The authors show that demographic background and empathy level correlate with LLM preferences . their findings highlight the need for demographically informed LLM evaluations.
Probabilistic Aggregation and Targeted Embedding Optimization for Collective Moral Reasoning in Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have impressive moral reasoning abilities, yet they often diverge when confronted with complex, multi-factor moral dilemmas.
Approach: They propose a framework that synthesizes multiple LLMs’ moral judgments into a collectively formulated moral judgment, realigning models that deviate significantly from this consensus.
Outcome: The proposed framework synthesizes multiple LLMs’ moral judgments into a collectively formulated moral judgment, realigning models that deviate significantly from this consensus.
Diagnosing Moral Reasoning Acquisition in Language Models: Pragmatics and Generalization (2025.findings-emnlp)

Copied to clipboard

Challenge: Prior research has shown that LLMs fail to perform satisfactorily on moral cognizance tasks .
Approach: They propose to use curated datasets to improve LLMs' moral cognizance . they find pragmatic dilemma constrains generalization ability of current learning paradigms .
Outcome: The proposed learning paradigms fail to perform on moral cognizance tasks, the authors show . they show that the pragmatic dilemma is the primary bottleneck for moral reasoning acquisition .
Knowledge of cultural moral norms in large language models (2023.acl-long)

Copied to clipboard

Challenge: Existing studies do not examine moral variation in a diverse cultural setting.
Approach: They investigate whether monolingual English language models capture moral variation across cultures . they use data from the World Values Survey and PEW global surveys .
Outcome: The proposed models predict moral norms worse than the English models reported previously . the models improve inference across countries at the expense of an accurate estimate .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations