Social Norms-Grounded Machine Ethics in Complex Narrative Situation (2022.coling-1)
Copied to clipboard
| Challenge: | Recent studies focus on data-driven methods to judge the ethics of complex real-world narratives but face two major challenges: they cannot handle dilemma situations due to a lack of basic knowledge about social norms; and they focus on sparse situation-level judgment regardless of the social norm. |
| Approach: | They propose to complement a complex situation with grounded social norms by a norm-supported ethical judgment model in line with neural module networks to alleviate dilemma situations and improve norm-level explainability. |
| Outcome: | The proposed model improves state-of-the-art performance on two narrative judgment benchmarks. |
Similar Papers
Moral Stories: Situated Reasoning about Norms, Intents, Actions, and their Consequences (2021.emnlp-main)
Copied to clipboard
| Challenge: | aaron carroll: in social settings, human behavior is governed by unspoken rules of conduct rooted in societal norms . carroll and colleagues examine whether language generation models can serve as behavioral priors if they are not . they say we examine whether they can generate descriptions of actions that accomplish predefined goals . |
| Approach: | They propose to combine multiple expert models to improve quality of generated actions, consequences, and norms. |
| Outcome: | The proposed models significantly improve the quality of generated actions, consequences, and norms compared to baselines. |
Contextualizing Language Models for Norms Diverging from Social Majority (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies on transformer-based language models have shown that there seems to be a 'moral dimension' to LMs, as they show high accuracy in related downstream tasks such as moral reasoning and action classification. |
| Approach: | They propose a mechanism based on deontic logic to allow for a flexible adaptation of individual norms by de-biasing training data sets and a task-reduction to textual entailment. |
| Outcome: | The proposed mechanism de-biases training data sets and reduces tasks to textual entailment. |
On the Machine Learning of Ethical Judgments from Natural Language (2022.naacl-main)
Copied to clipboard
| Challenge: | a recent study examines the morality of NLP models that can take in arbitrary text and output a moral judgment . a Delphi project is a popular system for moral prediction, but it has received criticism . |
| Approach: | They propose to critique NLP methods for automating ethical decision-making . they examine a nascent task of predicting moral and ethical decisions from text . |
| Outcome: | The proposed model is unsafe at any accuracy, the authors argue . they argue that the proposed model could be useful in NLP, but not in AI. |
Aligning to Social Norms and Values in Interactive Narratives (2022.naacl-main)
Copied to clipboard
| Challenge: | Social value alignment is the ability to create agents that act in alignment with socially beneficial norms and values in interactive narratives or text-based games. |
| Approach: | They introduce a game-value ALignment agent that uses social commonsense to restrict its action space to actions that are aligned with socially beneficial values. |
| Outcome: | The proposed agent improves state-of-the-art task performance by 4% while reducing the frequency of socially harmful behaviors by 25% compared to strong contemporary value alignment approaches. |
Social Chemistry 101: Learning to Reason about Social and Moral Norms (2020.emnlp-main)
Copied to clipboard
| Challenge: | SOCIAL CHEMISTRY is a conceptual formalism to study people’s everyday social norms and moral judgments over a rich spectrum of real life situations described in natural language. |
| Approach: | They propose a new conceptual formalism to study people's everyday social norms and moral judgments over a rich spectrum of real life situations described in natural language. |
| Outcome: | The proposed model can be used to model people's everyday social norms and moral judgments over a rich spectrum of real life situations. |
Rethinking Machine Ethics – Can LLMs Perform Moral Reasoning through the Lens of Moral Theories? (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to making moral judgments are mostly bottom-up and lack explainability. |
| Approach: | They propose a top-down framework to steer Large Language Models to perform moral reasoning with well-established moral theories. |
| Outcome: | The proposed framework can integrate various moral theories on moral datasets. |
NormBank: A Knowledge Bank of Situational Social Norms (2023.acl-long)
Copied to clipboard
| Challenge: | NormBank is a knowledge bank of 155k situational norms that can be used to ground flexible normative reasoning for interactive, assistive, and collaborative AI systems. |
| Approach: | They propose a new scheme for hierarchically organizing the seemingly unbounded social norms within a multivalent sociocultural frame. |
| Outcome: | The proposed framework can be used to ground flexible reasoning for interactive, assistive, and collaborative AI systems. |
The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems (2022.acl-long)
Copied to clipboard
| Challenge: | Moral integrity corpus captures the moral assumptions of 38k prompt-reply pairs, using 99k distinct Rules of Thumb (RoTs). |
| Approach: | They propose a resource that captures the moral assumptions of 38k prompt-reply pairs, using 99k distinct Rules of Thumb (RoTs). |
| Outcome: | The proposed resource captures the moral assumptions of 38k prompt-reply pairs, using 99k distinct Rules of Thumb (RoTs). |
ValueScope: Unveiling Implicit Norms and Values via Return Potential Model of Social Interactions (2024.findings-emnlp)
Copied to clipboard
Chan Young Park, Shuyue Stella Li, Hayoung Jung, Svitlana Volkova, Tanu Mitra, David Jurgens, Yulia Tsvetkov
| Challenge: | VALUESCOPE is a framework that quantifies social norms and values within online communities. |
| Approach: | They propose a framework that uses language models to quantify social norms and values within online communities. |
| Outcome: | The proposed framework delineates differences in social norms and tracks evolution of norms in online communities and influence of significant external events like the U.S. presidential elections and the emergence of new sub-communities. |
Can I Introduce My Boyfriend to My Grandmother? Evaluating Large Language Models Capabilities on Iranian Social Norm Classification (2025.findings-naacl)
Copied to clipboard
| Challenge: | Introducing the Iranian Social Norms dataset, a collection of 1,699 social norms, with Farsi adding linguistic complexity. |
| Approach: | They propose a collection of Iranian social norms with English translations and a novel Iranian dataset. |
| Outcome: | The Iranian Social Norms dataset is the first to be used in the Farsi language . it includes 1,699 social norms including environments, demographic features, and scope annotation, alongside English translations. |