| Challenge: | Existing methods for debiasing protected attributes have been limited to binary attributes in isolation, however many corpora involve multiple such attributes, possibly with higher cardinality. |
| Approach: | They propose to evaluate a bias-constrained model which is new to NLP and an extension of the iterative nullspace projection technique which can handle multiple identities. |
| Outcome: | The proposed model is based on a new iterative nullspace projection technique which can handle multiple identities. |
Similar Papers
Benchmarking Intersectional Biases in NLP (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent work on fairness of machine learning models has focused on how to debias, but research on the fairness and performance of biased/debiased models on downstream prediction tasks has been limited. |
| Approach: | They assess intersectional bias - fairness across multiple demographic dimensions . they highlight possible causes and make recommendations for future NLP debiasing research. |
| Outcome: | The proposed approaches fare well in terms of fairness-accuracy trade-off, but are unable to effectively alleviate bias in downstream tasks. |
Debiasing Word Embeddings with Nonlinear Geometry (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for debiasing word embeddings are limited to individual social categories . however, real-world corpora typically present multiple social categories that may correlate or intersect with each other. |
| Approach: | They propose a method to debias word embeddings using nonlinear geometry of individual biases. |
| Outcome: | Empirical results show that the proposed method mitigates biases associated with individual social categories and treats each category in isolation. |
Fair Enough: Standardizing Evaluation and Model Selection for Fairness Research in NLP (2023.eacl-main)
Copied to clipboard
| Challenge: | Modern NLP systems exhibit a range of biases, which a growing literature on model debiasing attempts to correct. |
| Approach: | They propose to clarify the current situation and plot a course for meaningful progress in fair learning by making clear inter-relations among the current gamut of methods and their relation to fairness theory. |
| Outcome: | The proposed approach addresses the practical problem of model selection, which involves a trade-off between fairness and accuracy and has led to systemic issues in fairness research. |
Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them (N19-1)
Copied to clipboard
| Challenge: | Existing methods to remove gender bias from word embeddings are insufficient, we argue . existing methods for gender-neutral modeling are ineffective, we conclude . |
| Approach: | They propose methods to reduce gender bias in word embeddings by debiasing them using text corpora. |
| Outcome: | The proposed methods show that they can reduce gender bias in word embeddings . the proposed methods are insufficient and should not be trusted, the authors argue . |
More than Minorities and Majorities: Understanding Multilateral Bias in Language Generation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on bias dataset construction and mitigation focus on one demographic group . in real-world applications, there are more than two demographic groups at risk of the same bias. |
| Approach: | They propose to analyze and reduce biases across multiple demographic groups using a multi-demographic bias dataset. |
| Outcome: | The proposed method can mitigate biases among multiple demographic groups effectively, the authors show . |
Thesis Proposal: Auditing and Mitigating Demographic Bias in Multi-Stage Retrieval Systems for Criminal Justice Applications (2026.acl-srw)
Copied to clipboard
| Challenge: | racial descriptors alter embedding similarity scores and retrieval rankings, a new study shows . rife-specific biases can displace relevant records outside top-10 results, the study concludes . |
| Approach: | They propose to detect, measure, and mitigate racial bias in NLP systems deployed in criminal justice contexts . they propose to develop and evaluate debiasing techniques, validate synthetic findings on authentic law enforcement data . |
| Outcome: | The proposed research examines how bias propagates across retrieval pipelines . it shows that racial descriptors alter embedding similarity scores and retrieval rankings . |
Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddings (N19-1)
Copied to clipboard
| Challenge: | Existing methods to debias word embeddings in binary settings such as gender and religion are limited to binary labels, whereas word2vec embedders can be used to propagate biases. |
| Approach: | They propose a method to debias word embeddings in multiclass settings such as gender and religion, extending the work of Bolukbasi et al. (2016). |
| Outcome: | The proposed method maintains the efficacy in standard NLP tasks while maintaining the utility of embeddings. |
Mitigating Gender Bias in Natural Language Processing: Literature Review (P19-1)
Copied to clipboard
Tony Sun, Andrew Gaut, Shirlyn Tang, Yuxin Huang, Mai ElSherief, Jieyu Zhao, Diba Mirza, Elizabeth Belding, Kai-Wei Chang, William Yang Wang
| Challenge: | NLP models propagate and may even amplify gender bias found in text corpora . methods to mitigate gender bias in NLP are relatively nascent . |
| Approach: | They propose to analyze gender bias based on four forms of representation bias and discuss the advantages and drawbacks of existing gender debiasing methods. |
| Outcome: | The proposed methods are based on four forms of representation bias and have advantages and drawbacks. |
Unequal Representations: Analyzing Intersectional Biases in Word Embeddings Using Representational Similarity Analysis (2020.coling-main)
Copied to clipboard
| Challenge: | Specifically, we probe contextualized and non-contextualized word embeddings for evidence of intersectional biases against Black women. |
| Approach: | They propose a representational similarity analysis approach to detect human-like biases in word embeddings using representational similarities analysis. |
| Outcome: | The proposed approach aligns with intersectionality theory, which states that multiple identity categories layer on top of each other to create unique modes of discrimination that are not shared by any individual category. |
InterFair: Debiasing with Natural Language Feedback for Fair Interpretable Predictions (2023.emnlp-main)
Copied to clipboard
| Challenge: | Debiasing methods in NLP models focus on isolating information related to a sensitive attribute (e.g., gender or race) but instead argue that a favorable debiaser should use sensitive information ‘fairly,’ with explanations, rather than blindly eliminating it. |
| Approach: | They propose that a favorable debiasing method should use sensitive information ‘fairly,’ with explanations, rather than blindly eliminating it. |
| Outcome: | The proposed approach reduces bias in explanations while maintaining the same prediction accuracy. |