Evaluating Gender Bias of LLMs in Making Morality Judgements (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable capabilities in a multitude of NLP tasks, but are still not immune to limitations such as gender bias. |
| Approach: | They propose to use a dataset to examine whether LLMs possess gender bias when asked to give moral opinions. |
| Outcome: | The proposed models show that they are biased when asked to give moral opinions. |
Similar Papers
Gender Bias in Decision-Making with Large Language Models: A Study of Relationship Conflicts (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models acquire beliefs about gender from training data and can therefore generate text with stereotypical gender attitudes. |
| Approach: | They use a decision-making lens to examine gender equity within large language models . they explore relationships through typical and gender-neutral names . |
| Outcome: | The proposed model generation and classification models exhibit stereotypical gender biases . the proposed model generates gender-neutral names, with and without safety enhancements, and egalitarian versus traditional scenarios across topics. |
Mitigating Gender Bias via Fostering Exploratory Thinking in LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models often exhibit gender bias, resulting in unequal treatment of male and female subjects across contexts. |
| Approach: | They propose a framework that encourages exploratory thinking in large language models . the framework generates story pairs featuring male and female protagonists in structurally identical scenarios . |
| Outcome: | The proposed framework reduces gender bias while preserving or even enhancing general model capabilities. |
“Fifty Shades of Bias”: Normative Ratings of Gender Bias in GPT Generated English Text (2023.emnlp-main)
Copied to clipboard
| Challenge: | Prior work treats gender bias as a binary classification task, but a comparative annotation framework can be used to assess the impact of biases. |
| Approach: | They propose to generate a dataset with normative ratings of gender bias in English text with a comparative annotation framework. |
| Outcome: | The first dataset of GPT-generated English text with normative ratings of gender bias is analyzed using Best–Worst Scaling . |
Causally Testing Gender Bias in LLMs: A Case Study on Occupational Bias (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies have shown that large language models can cause harmful, human-like biases against various demographics. |
| Approach: | They propose a causal formulation for bias measurement in generative language models based on a list of desiderata for designing robust bias benchmarks and a bias-measuring procedure to investigate occupational gender bias. |
| Outcome: | The proposed framework is generalizable and can be extended to include other datasets. |
Hire Me or Not? Examining Language Model’s Behavior with Occupation Attributes (2025.coling-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been widely integrated into production pipelines due to their impressive performance across multiple tasks. |
| Approach: | They construct a dataset using a standard occupation classification knowledge base and tested it on three families of LLMs. |
| Outcome: | The proposed framework analyzes LLMs’ behavior with respect to gender stereotypes in the context of occupation decision making. |
Unraveling Downstream Gender Bias from Large Language Models: A Study on AI Educational Writing Assistance (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly utilized in educational tasks such as providing writing suggestions to students. |
| Approach: | They conduct a large-scale user study with 231 students writing business case peer reviews in german. |
| Outcome: | The proposed model does not carry bias in the feedback loops of the students . |
“Kelly is a Warm Person, Joseph is a Role Model”: Gender Biases in LLM-Generated Reference Letters (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are an effective tool to assist individuals in writing documents. |
| Approach: | They examine gender biases in large language models (LLMs)-generated reference letters . they find that models are biased because they are hallucinated . |
| Outcome: | The proposed model-generated reference letters are evaluated on 2 popular LLMs- ChatGPT and Alpaca. |
Adaptable Moral Stances of Large Language Models on Sexist Content: Implications for Society and Gender Discourse (2024.emnlp-main)
Copied to clipboard
| Challenge: | Using large language models, large language model learning has become more integrated into our daily lives, making it increasingly important to ensure they reflect ethical and equitable values. |
| Approach: | They assess how LLMs can apply moral reasoning to both criticize and defend sexist language by evaluating their models and evaluating the moral foundations cited by them. |
| Outcome: | The models show they can provide comprehensible and contextually relevant text for understanding diverse views on how sexism is perceived. |
Job Unfair: An Investigation of Gender and Occupational Bias in Free-Form Text Completions by LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | a recent study has identified that LLMs are used in domains where they support or replace human decision-making . a systematic review of LLM outputs shows that many facets of social bias remain unaccounted for . |
| Approach: | They propose to disentangle gender and occupational biases in Italian and English as expressed by LLMs. |
| Outcome: | The proposed method captures gender and occupational biases in Italian and English . it also shows that models struggle with gender-neutral expressions, especially beyond English - the authors conclude . |
In-Contextual Gender Bias Suppression for Large Language Models (2024.findings-eacl)
Copied to clipboard
| Challenge: | Prior work has proposed debiasing methods that require human labelled examples, data augmentation and fine-tuning of LLMs, which are computationally expensive. |
| Approach: | They propose to suppress gender biases by providing textual preambles from manually designed templates and real-world statistics without accessing model parameters. |
| Outcome: | The proposed methods suppress gender biases in English LLMs using a CrowsPairs dataset without accessing model parameters. |