ETHICA-MT: Introducing a Framework and Dataset for Studying Ethical Orientations in LLM-based Machine Translation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing models for translation have not been systematically examined for their default ethical tendencies or their ability to employ and prioritize specified ethical approaches in conflicted translation situations. |
| Approach: | They propose a framework for examining ethical reasoning and implementation in large language models (LLMs) that systematically examines default ethical tendencies and their ability to employ and prioritize specified ethical approaches in conflicted translation situations. |
| Outcome: | The proposed framework examines the ethical reasoning and implementation of large language models in translation tasks. |
Similar Papers
Ethical Considerations for Machine Translation of Indigenous Languages: Giving a Voice to the Speakers (2023.acl-long)
Copied to clipboard
| Challenge: | In recent years, machine translation has become very successful for high-resource language pairs. |
| Approach: | They conduct interviews with community leaders, teachers, and language activists to shed light on ethical considerations for the automatic translation of Indigenous languages. |
| Outcome: | The results show that the inclusion of native speakers and community members is vital to performing better and more ethical research on Indigenous languages. |
Ethical Considerations for Low-resourced Machine Translation (2022.acl-srw)
Copied to clipboard
| Challenge: | a paper examines the ethical implications of machine translation for low-resourced languages . a value scenario illustrates potential harms that low-rsourced language communities may face . |
| Approach: | They propose to use Armenian as a case study to investigate ethical implications of machine translation for low-resourced languages. |
| Outcome: | The proposed model is based on a value-scenario model of machine translation for low-resourced languages . the model is used to identify potential harms that low-income speakers may face . |
The Only Way is Ethics: A Guide to Ethical Research with Large Language Models (2025.coling-main)
Copied to clipboard
Eddie L. Ungless, Nikolas Vitsakis, Zeerak Talat, James Garforth, Bjorn Ross, Arno Onken, Atoosa Kasirzadeh, Alexandra Birch
| Challenge: | Existing literature on the ethical aspects of large language models (LLMs) is lacking a single practical guide on the subject. |
| Approach: | They propose to translate ethics literature into concrete recommendations for computer scientists by presenting an open and living resource for NLP practitioners and those tasked with evaluating the ethical implications of others’ work. |
| Outcome: | The proposed guide is an open and living resource for NLP practitioners and those tasked with evaluating the ethical implications of others’ work. |
MedEthicEval: Evaluating Large Language Models Based on Chinese Medical Ethics (2025.naacl-industry)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been used in clinical decision support, medical education and patient communication. |
| Approach: | They propose a benchmark to evaluate large language models in the domain of medical ethics and assess their grasp of medical ethical principles and their application across diverse scenarios. |
| Outcome: | The proposed framework assesses the models’ grasp of medical ethics principles and their ability to apply them across diverse scenarios. |
An Interdisciplinary Approach to Human-Centered Machine Translation (2025.emnlp-main)
Copied to clipboard
Marine Carpuat, Omri Asscher, Kalika Bali, Luisa Bentivogli, Fred Blain, Lynne Bowker, Monojit Choudhury, Hal Daumé Iii, Kevin Duh, Ge Gao, Alvin C Grissom II, Marzena Karpinska, Elaine C Khoong, William D. Lewis, Andre Martins, Mary Nurminen, Douglas W. Oard, Maja Popovic, Michel Simard, François Yvon
| Challenge: | Despite progress in MT, a gap persists between how the technology is developed and how it is used in real-world contexts. |
| Approach: | They propose a human-centered approach to machine translation (MT) they argue that MT should be evaluated with diverse goals and contexts of use . |
| Outcome: | The proposed approach emphasizes alignment of evaluation and design with diverse communicative goals and contexts of use. |
Ethical Reasoning and Moral Value Alignment of LLMs Depend on the Language We Prompt Them in (2024.lrec-main)
Copied to clipboard
| Challenge: | Ethical reasoning is a crucial skill for Large Language Models (LLMs). However, moral values are not universal, but rather influenced by language and culture. |
| Approach: | They extend the study of ethical reasoning of LLMs by (CITATION) to a multilingual setup using six languages: English, Spanish, Russian, Chinese, Hindi, and Swahili. |
| Outcome: | The proposed model is based on a multilingual setup in English, Spanish, Russian, Chinese, Hindi, and Swahili. |
Ready to Translate, Not to Represent? Bias and Performance Gaps in Multilingual LLMs Across Language Families and Domains (2026.findings-acl)
Copied to clipboard
Md. Faiyaz Abdullah Sayeedi, Subhey Sadi Rahman, Md. Mahbub Alam, Md. Adnanul Islam, Jannatul Ferdous Deepti, Tasnim Mohiuddin, Md Mofijul Islam, Swakkhar Shatabda
| Challenge: | Large Language Models (LLMs) have redefined Machine Translation, enabling context-aware and fluent translations across hundreds of languages and textual domains. |
| Approach: | They propose a framework and dataset to evaluate the translation quality and fairness of open-source LLMs. |
| Outcome: | The proposed framework and dataset evaluates translation quality and fairness of open-source LLMs. |
MT-GenEval: A Counterfactual and Contextual Dataset for Evaluating Gender Accuracy in Machine Translation (2022.emnlp-main)
Copied to clipboard
Anna Currey, Maria Nadejde, Raghavendra Reddy Pappagari, Mia Mayer, Stanislas Lauly, Xing Niu, Benjamin Hsu, Georgiana Dinu
| Challenge: | Existing benchmarks have limited diversity in terms of gender phenomena, sentence structure, or language coverage. |
| Approach: | They propose a benchmark to evaluate gender accuracy in translation from English into eight widely-spoken languages. |
| Outcome: | The proposed benchmark provides realistic, gender-balanced, counterfactual data in eight language pairs where the gender of individuals is unambiguous in the input segment. |
Rethinking Machine Ethics – Can LLMs Perform Moral Reasoning through the Lens of Moral Theories? (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to making moral judgments are mostly bottom-up and lack explainability. |
| Approach: | They propose a top-down framework to steer Large Language Models to perform moral reasoning with well-established moral theories. |
| Outcome: | The proposed framework can integrate various moral theories on moral datasets. |
Languages Still Left Behind: Toward a Better Multilingual Machine Translation Benchmark (2025.emnlp-main)
Copied to clipboard
Chihiro Taguchi, Seng Mai, Keita Kurabe, Yusuke Sakai, Georgina Agyei, Soudabeh Eslami, David Chiang
| Challenge: | Multilingual machine translation (MT) benchmarks are widely used to evaluate the capabilities of modern MT systems. |
| Approach: | They propose to use a multilingual machine translation benchmark to assess the capabilities of modern machine translation systems. |
| Outcome: | The FLORES+ benchmark claims to maintain a translation quality score of over 90% . however, the data in four languages falls short of the 90% quality standard . |