Papers by Keenan Samway
Are Language Models Consequentialist or Deontological Moral Reasoners? (2025.emnlp-main)
Copied to clipboard
Keenan Samway, Max Kleiman-Weiner, David Guzman Piedrahita, Rada Mihalcea, Bernhard Schölkopf, Zhijing Jin
| Challenge: | Recent studies have focused on the moral judgments in large language models rather than their underlying moral reasoning process. |
| Approach: | They propose a taxonomy of moral rationales to classify reasoning traces according to consequentialism and deontology . they use trolley problems to analyze moral reasoning tracing in large language models . |
| Outcome: | The proposed taxonomy of moral rationales sheds light on consequentialism and deontology . it systematically classifies reasoning traces according to two main ethical theories . |
Test of Time: Rethinking Temporal Signal of Benchmark Contamination (2026.acl-long)
Copied to clipboard
Terry Jingchen Zhang, Gopal Dev, Ning Wang, Max Obreiter, Punya Syon Pandey, Keenan Samway, Wenyuan Jiang, Yinya Huang, Bernhard Schölkopf, Mrinmaya Sachan, Zhijing Jin
| Challenge: | Existing work on benchmarks containing publicly available information has been interpreted as a temporal signal for benchmark contamination. |
| Approach: | They show that LLM-transformed questions can produce remarkably different temporal patterns compared to fill-in-the-blank questions directly retrieved from the very same documents. |
| Outcome: | The proposed model can produce different temporal patterns compared to fill-in-the-blank questions retrieved from the same documents. |
When Do Language Models Endorse Limitations on Human Rights Principles? (2026.findings-eacl)
Copied to clipboard
Keenan Samway, Miu Nicole Takagi, Rada Mihalcea, Bernhard Schölkopf, Ilias Chalkidis, Daniel Hershcovich, Zhijing Jin
| Challenge: | a recent study evaluated how large language models navigate trade-offs involving the Universal Declaration of Human Rights. |
| Approach: | They evaluate how large language models navigate trade-offs involving the Universal Declaration of Human Rights (UDHR) they use 1,152 synthetically generated scenarios across 24 rights articles and eight languages . |
| Outcome: | The proposed models accept limiting economic, social, and cultural rights more often than political and civil rights, the authors show . their models show significant cross-linguistic variation with elevated endorsement rates of rights-limiting actions in Chinese and Hindi compared to English or Romanian . |
NLP for Social Good: A Survey and Outlook of Challenges, Opportunities and Responsible Deployment (2026.eacl-long)
Copied to clipboard
Antonia Karamolegkou, Angana Borah, Eunjung Cho, Sagnik Ray Choudhury, Martina Galletti, Pranav Gupta, Oana Ignat, Priyanka Kargupta, Neema Kotonya, Hemank Lamba, Sun-Joo Lee, Arushi Mangla, Ishani Mondal, Fatima Zahra Moudakir, Deniz Nazar, Poli Nemkova, Dina Pisarevskaya, Naquee Rizwan, Nazanin Sabri, Keenan Samway, Dominik Stammbach, Anna Steinberg Schulten, David Tomás, Steven R Wilson, Bowen Yi, Jessica H Zhu, Arkaitz Zubiaga, Anders Søgaard, Alexander Fraser, Zhijing Jin, Rada Mihalcea, Joel R. Tetreault, Daryna Dementieva
| Challenge: | This paper surveys work in "NLP for Social Good" across nine domains relevant to global development and risk agendas. |
| Approach: | This paper analyzes work in "NLP for Social Good" across nine domains relevant to global development and risk agendas. |
| Outcome: | The paper analyzes work in "NLP for Social Good" across nine domains relevant to global development and risk agendas. |