| Challenge: | Existing studies show that training word embeddings in large corpora could lead to encoding societal biases present in these human-produced data. |
| Approach: | They conduct several intrinsic analyses to quantify, analyze and mitigate gender bias exhibited in ELMo’s contextualized word vectors. |
| Outcome: | The proposed method mitigates gender bias on WinoBias probing corpus and demonstrates that it can be implemented in other systems. |
Similar Papers
Identifying and Reducing Gender Bias in Word-Level Language Models (N19-3)
Copied to clipboard
| Challenge: | Existing discriminatory biases in training data can be amplified by models . text corpora exhibit socially problematic biase . |
| Approach: | They propose a metric to measure gender bias and a regularization loss term to minimize embeddings onto an embeddable subspace that encodes gender. |
| Outcome: | The proposed method reduces gender bias up to an optimal weight assigned to the loss term, and the model becomes unstable as the perplexity increases. |
Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods (N18-2)
Copied to clipboard
| Challenge: | Existing methods for co-reference resolution focus on gender bias. |
| Approach: | They propose a new benchmark for co-reference resolution focused on gender bias, WinoBias. |
| Outcome: | The proposed system removes the bias without significantly affecting performance on existing datasets. |
Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Models (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing benchmarks do not probe professional bias as pronoun resolution may be obfuscated by cross-correlations from other manifestations of gender prejudice. |
| Approach: | They propose to use a skew and stereotype metrics to quantify and analyse the gender bias present in contextual language models when tackling the WinoBias pronoun resolution task. |
| Outcome: | The proposed methods reduce skew and stereotype relative to the unaugmented fine-tuned BERT model. |
Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them (N19-1)
Copied to clipboard
| Challenge: | Existing methods to remove gender bias from word embeddings are insufficient, we argue . existing methods for gender-neutral modeling are ineffective, we conclude . |
| Approach: | They propose methods to reduce gender bias in word embeddings by debiasing them using text corpora. |
| Outcome: | The proposed methods show that they can reduce gender bias in word embeddings . the proposed methods are insufficient and should not be trusted, the authors argue . |
Mind Your Bias: A Critical Review of Bias Detection Methods for Contextual Language Models (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for detection of biases in contextual language models are inconsistent and inconclusive. |
| Approach: | They propose to use word embedding association test to detect biases in contextual language models to compare them with other methods. |
| Outcome: | The proposed methods are inconsistent and inconclusive for language models with word embeddings. |
Examining Gender Bias in Languages with Grammatical Gender (D19-1)
Copied to clipboard
| Challenge: | Existing studies on gender bias in word embeddings focus on English . however, these studies cannot be extended to languages with morphological agreement on gender . |
| Approach: | They propose new metrics to evaluate gender bias in word embeddings of English and Spanish . they extend existing approaches to mitigate gender bias while preserving original embeddables . |
| Outcome: | The proposed methods reduce gender bias while preserving the original embeddings. |
Neutralizing Gender Bias in Word Embeddings with Latent Disentanglement and Counterfactual Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent research shows word embeddings have strong gender biases in embeddable spaces . a proposed method can be used to debiase word embeds without loss of semantic information . |
| Approach: | They propose a latent disentanglement method with a siamese auto-encoder structure with an adapted gradient reversal layer to debiase word embeddings. |
| Outcome: | The proposed method can preserve semantic information during debiasing while minimizing loss of semantic information for extrinsic NLP tasks. |
Double-Hard Debias: Tailoring Word Embeddings for Gender Bias Mitigation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to debias word embeddings from human-generated corpora inherit strong gender bias . prior work has suggested removing gender component from pre-trained word embeds or compressing gender information into a few dimensions of the embeddable space . |
| Approach: | They propose a technique that purifies word embeddings against inferred gender subspaces . they propose to preserve distributional semantics of pre-trained word embeds while reducing gender bias . |
| Outcome: | The proposed technique preserves distributional semantics of pre-trained word embeddings while reducing gender bias to a larger degree than prior approaches. |
Robustness and Reliability of Gender Bias Assessment in Word Embeddings: The Role of Base Pairs (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing methods to quantify gender bias in word embeddings are not robust and cannot identify common types of bias. |
| Approach: | They propose to quantify gender bias by using cosine similarity to a pair of gender words and using analogies. |
| Outcome: | The proposed methods are not robust and cannot identify common types of bias, while analogies are unsuitable indicators. |
Gender Bias in Coreference Resolution (N18-2)
Copied to clipboard
| Challenge: | a study of coreference resolution systems that resolve gender differences in pairs is aimed at examining implicit gender biases. |
| Approach: | They propose a Winograd schema-style set of minimal pair sentences that differ only by gender . they evaluate and confirm systematic gender bias in three publicly-available coreference resolution systems . |
| Outcome: | The proposed system resolves a male and neutral pronoun as coreferent with "The surgeon" but does not resolve the female pronounce. |