How Conservative are Language Models? Adapting to the Introduction of Gender-Neutral Pronouns (2022.naacl-main)
Copied to clipboard
| Challenge: | a recent study shows that gender-neutral pronouns are not associated with processing difficulties . linguistic scholars have observed how technology has altered the course of language evolution . |
| Approach: | They show that gender-neutral pronouns in Danish, English and Swedish are not associated with processing difficulties. |
| Outcome: | a new study shows that gender-neutral pronouns are not associated with human processing difficulties . the findings suggest that such conservativity in language models may limit widespread adoption . |
Similar Papers
What about “em”? How Commercial Machine Translation Fails to Handle (Neo-)Pronouns (2023.acl-long)
Copied to clipboard
| Challenge: | Wrong pronoun translations can discriminate against marginalized groups, e.g., non-binary individuals. |
| Approach: | They compare 3rd-person pronoun translations to five other languages . they propose to address gender exclusivity in future research . |
| Outcome: | The proposed method compares translations of gendered vs. gender-neutral pronouns from english to five other languages and vice versa. |
MISGENDERED: Limits of Large Language Models in Understanding Pronouns (2023.acl-long)
Copied to clipboard
| Challenge: | excluding non-binary gender identities can perpetuate harm against non-bisexual individuals through exclusion and marginalization. |
| Approach: | They propose a framework for evaluating large language models’ ability to correctly use preferred pronouns. |
| Outcome: | The proposed framework evaluates language models' ability to correctly use preferred pronouns in English. |
Welcome to the Modern World of Pronouns: Identity-Inclusive Natural Language Processing beyond Gender (2022.coling-1)
Copied to clipboard
| Challenge: | Current modeling of 3rd person pronouns ignores neopronoun phenomena like naive pronounes, which are not (yet) widely established. |
| Approach: | They propose to validate existing and novel approaches for modeling 3rd person pronouns in language technology and validate them through a survey. |
| Outcome: | The proposed model excludes non-binary users, while ignoring gender-specific phenomena. |
Gender in Danger? Evaluating Speech Translation Technology on the MuST-SHE Corpus (2020.acl-main)
Copied to clipboard
| Challenge: | a growing number of studies have examined the issue of gender bias in speech translation . a gender bias is a systemic problem that reproduces gender stereotypes discriminating women. |
| Approach: | They present the first thorough investigation of gender bias in speech translation . they compare audio technologies for English-Italian/French translations . |
| Outcome: | The proposed method compares different technologies on two languages, English and French. |
Do language models practice what they preach? Examining language ideologies about gendered language reform encoded in LLMs (2025.coling-main)
Copied to clipboard
| Challenge: | Language ideologies are evaluative ideas or beliefs about language, such as ideas about what is "correct", "natural" or "articulate". |
| Approach: | They use gender-neutral variants more often when more explicit metalinguistic context is provided. |
| Outcome: | The findings show that language ideologies in LLMs can vary, which may be unexpected to users. |
What social attitudes about gender does BERT encode? Leveraging insights from psycholinguistics (2023.acl-long)
Copied to clipboard
| Challenge: | Much research has focused on evaluating whether large language models encode stereotypical/harmful associations. |
| Approach: | They propose to use two datasets from human experiments to examine how word preferences in a large language model reflect social attitudes about gender. |
| Outcome: | The language model BERT takes into account factors that shape human lexical choice of such language, but may not weigh those factors in the same way people do. |
Gendered Grammar or Ingrained Bias? Exploring Gender Bias in Icelandic Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models are trained on vast datasets and exhibit increased output quality in proportion to the amount of data that is used to train them. |
| Approach: | They explore whether language models mirror gender distributions within professions or exhibit biases tied to their grammatical genders. |
| Outcome: | The proposed model may reflect and amplify gender bias, racism, religious prejudice, and queerphobia in training data that may not always be recent. |
Different Speech Translation Models Encode and Translate Speaker Gender Differently (2025.acl-short)
Copied to clipboard
| Challenge: | Recent studies on interpreting the hidden states of speech models have shown their ability to capture speaker-specific features, including gender. |
| Approach: | They propose to use probing methods to assess gender encoding across ST models. |
| Outcome: | The proposed models capture speaker-specific features, including gender, while older models do not . low gender encoding capabilities result in systems’ tendency toward a masculine default, a translation bias that is more pronounced in newer architectures. |
A Tale of Pronouns: Interpretability Informs Gender Bias Mitigation for Fairer Instruction-Tuned Machine Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent instruction fine-tuned models can solve multiple NLP tasks when prompted to do so, but current research focuses on standard performance benchmarks, leaving compelling fairness and ethical considerations behind. |
| Approach: | They propose a method to mitigate gender bias in machine translation by using a corpus of machine translations from the WinoMT corpus. |
| Outcome: | The proposed model can solve multiple NLP tasks when prompted, but it lacks fairness and ethical considerations. |
Translate With Care: Addressing Gender Bias, Neutrality, and Reasoning in Large Language Model Translations (2025.findings-acl)
Copied to clipboard
| Challenge: | addressing gender bias and maintaining logical coherence in machine translation remains challenging, especially when translating between natural gender languages, like English, and genderless languages, such as Persian, Indonesian, and Finnish. |
| Approach: | They propose a dataset to assess translation systems' performance in six low- to mid-resource languages and a translation dataset to examine gender bias and logical coherence. |
| Outcome: | The Translate-with-Care dataset, comprising 3,950 challenging scenarios across six low- to mid-resource languages, reveals a universal struggle in translating genderless content, resulting in gender stereotyping and reasoning errors. |