Evaluating Gender Bias of Pre-trained Language Models in Natural Language Inference by Considering All Labels (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to evaluate gender bias in PLMs focus on one label out of three labels, such as neutral. |
| Approach: | They propose a bias evaluation method for PLMs that considers all the three labels of NLI task and then defines a measure based on the corresponding label output. |
| Outcome: | The proposed method can distinguish biased, incorrect inferences from non-biased incorrect infertility better than baseline, resulting in a more accurate bias evaluation. |
Similar Papers
Comparing Intrinsic Gender Bias Evaluation Measures without using Human Annotated Examples (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods to evaluate gender biases in pre-trained language models have been limited by the cost and difficulties of recruiting human annotators. |
| Approach: | They propose a method to compare intrinsic gender bias evaluation measures without relying on human annotated examples. |
| Outcome: | The proposed method compares gender-based gender bias evaluation measures without human annotators without human input. |
An Information-Theoretic Approach and Dataset for Probing Gender Stereotypes in Multilingual Masked Language Models (2022.findings-naacl)
Copied to clipboard
| Challenge: | Pretrained language models (PLMs) have been shown to encapsulate social biases, including those relating to gender and race. |
| Approach: | They propose a new bias measure based on Jensen–Shannon divergence that retains more information from the model output probabilities than other previously proposed bias measures. |
| Outcome: | The proposed measure outperforms CrowS-Pairs and other similar measures for non-English datasets. |
Mitigating Gender Bias in Natural Language Processing: Literature Review (P19-1)
Copied to clipboard
Tony Sun, Andrew Gaut, Shirlyn Tang, Yuxin Huang, Mai ElSherief, Jieyu Zhao, Diba Mirza, Elizabeth Belding, Kai-Wei Chang, William Yang Wang
| Challenge: | NLP models propagate and may even amplify gender bias found in text corpora . methods to mitigate gender bias in NLP are relatively nascent . |
| Approach: | They propose to analyze gender bias based on four forms of representation bias and discuss the advantages and drawbacks of existing gender debiasing methods. |
| Outcome: | The proposed methods are based on four forms of representation bias and have advantages and drawbacks. |
On Evaluating and Mitigating Gender Biases in Multilingual Settings (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks and resources for evaluating gender biases in multilingual settings are limited. |
| Approach: | They propose to extend DisCo to different Indian languages using human annotations to evaluate gender biases in multilingual models. |
| Outcome: | The proposed benchmarks and mitigation techniques are extended beyond English to evaluate gender biases in multilingual models. |
Gender Bias in Masked Language Models for Multiple Languages (2022.naacl-main)
Copied to clipboard
| Challenge: | Masked Language Models (MLMs) pre-trained by predicting masked tokens on large corpora have been used successfully in natural language processing tasks for a variety of languages. |
| Approach: | They propose to use English attribute word lists to evaluate bias in eight languages without manually annotating data. |
| Outcome: | The proposed model significantly correlates with the existing English datasets for gender bias. |
Identifying and Reducing Gender Bias in Word-Level Language Models (N19-3)
Copied to clipboard
| Challenge: | Existing discriminatory biases in training data can be amplified by models . text corpora exhibit socially problematic biase . |
| Approach: | They propose a metric to measure gender bias and a regularization loss term to minimize embeddings onto an embeddable subspace that encodes gender. |
| Outcome: | The proposed method reduces gender bias up to an optimal weight assigned to the loss term, and the model becomes unstable as the perplexity increases. |
Evaluating Gender Bias of LLMs in Making Morality Judgements (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable capabilities in a multitude of NLP tasks, but are still not immune to limitations such as gender bias. |
| Approach: | They propose to use a dataset to examine whether LLMs possess gender bias when asked to give moral opinions. |
| Outcome: | The proposed models show that they are biased when asked to give moral opinions. |
Monolingual and Multilingual Reduction of Gender Bias in Contextualized Representations (2020.coling-main)
Copied to clipboard
| Challenge: | Prior work identifies a linear gender subspace and removes gender information by eliminating the subspace. |
| Approach: | They propose to use DensRay to obtain interpretable dense subspaces by applying it to attention heads and layers of BERT. |
| Outcome: | The proposed method performs on-par with prior approaches, but is more robust and preserves language model performance better. |
Bias Beyond English: Counterfactual Tests for Bias in Sentiment Analysis in Four Languages (2023.findings-acl)
Copied to clipboard
| Challenge: | Sentiment analysis systems are used in hundreds of products and languages . Gender and racial biases are well-studied in English, but understudied elsewhere . |
| Approach: | They build a counterfactual evaluation corpus for gender and racial/migrant bias in four languages. |
| Outcome: | The evaluation corpus reveals which models have less bias and pinpoints changes in model bias behaviour, enabling more targeted mitigation strategies. |
Bias and Fairness in Natural Language Processing (D19-2)
Copied to clipboard
| Challenge: | a tutorial will review the history of bias and fairness studies in machine learning and language processing . |
| Approach: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it presents recent community effort to quantify and mitigat bias in natural language processing models . |
| Outcome: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it aims to quantify and mitigate bias in natural language processing models for a wide spectrum of tasks . |