Challenge: Existing work in this field has looked most commonly into gender bias, racial bias, and religious bias.
Approach: They propose an algorithm that uses a neural network to perform ‘soft debiasing’ and build on the seminal work of (CITATION) and (CitATION).
Outcome: The proposed algorithm outperforms current methods on gender, race, and religion metrics on a wide range of metrics.

Similar Papers

Bias and Fairness in Natural Language Processing (D19-2)

Copied to clipboard

Challenge: a tutorial will review the history of bias and fairness studies in machine learning and language processing .
Approach: This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it presents recent community effort to quantify and mitigat bias in natural language processing models .
Outcome: This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it aims to quantify and mitigate bias in natural language processing models for a wide spectrum of tasks .
Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddings (N19-1)

Copied to clipboard

Challenge: Existing methods to debias word embeddings in binary settings such as gender and religion are limited to binary labels, whereas word2vec embedders can be used to propagate biases.
Approach: They propose a method to debias word embeddings in multiclass settings such as gender and religion, extending the work of Bolukbasi et al. (2016).
Outcome: The proposed method maintains the efficacy in standard NLP tasks while maintaining the utility of embeddings.
Debiasing Large Language Models with Structured Knowledge (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods to reduce biases in pre-training models are hampered by their performance.
Approach: They propose a method that utilizes structured knowledge to mitigate bias in LLMs . their method obviates the need for training from scratch, thus offering enhanced scalability .
Outcome: The proposed method outperforms state-of-the-art (SOTA) baselines in the debiasing ability.
Data-Centric Explainable Debiasing for Improving Fairness in Pre-trained Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing data-centric debiasing strategies mainly leverage explicit bias words for counterfactual data augmentation to balance the training data.
Approach: They propose a method which uses an explainability method to search for implicit bias words to assist in debiasing PLMs.
Outcome: Extensive results show that the proposed method achieves state-of-the-art debiasing performance and strong generalization while maintaining predictive abilities.
Debiasing Pre-trained Contextualised Embeddings (2021.eacl-main)

Copied to clipboard

Challenge: a study of contextualised word embeddings shows discriminative biases are encoded in contextualised embeddables.
Approach: They propose a fine-tuning method that can be applied at token- or sentence-levels to debias pre-trained contextualised embeddings.
Outcome: The proposed method can be applied at token- or sentence-levels to debias pre-trained models without requiring retrains.
Applying Intrinsic Debiasing on Downstream Tasks: Challenges and Considerations for Machine Translation (2024.emnlp-main)

Copied to clipboard

Challenge: In this study, we examine three considerations for intrinsic debiasing in neural machine translation models.
Approach: They propose to measure the extrinsic bias of neural machine translation models by embedding them in a neural embeddable space and using different tokens to debias them.
Outcome: The proposed methods over-rely on gender stereotypes and over-represent them in their models.
Towards Debiasing Sentence Representations (2020.acl-main)

Copied to clipboard

Challenge: Recent work has shown word-level embeddings reflect and propagate social biases present in training corpora.
Approach: They propose a method to debias word embeddings to reduce biases at sentence level . they hope their work will inspire future research on characterizing and removing biase .
Outcome: The proposed method reduces biases and preserves performance on downstream tasks such as sentiment analysis and natural language understanding.
The Medium Is Not the Message: Deconfounding Document Embeddings via Linear Concept Erasure (2025.emnlp-main)

Copied to clipboard

Challenge: Embedding-based similarity metrics can be influenced by content dimensions and spurious attributes like the text’s source or language.
Approach: They propose a debiasing algorithm that removes observed confounders from encoder representations and removes them from the encoder.
Outcome: The proposed method improves on out-of-distribution benchmarks and on benchmarks, but performance is not affected.
Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them (N19-1)

Copied to clipboard

Challenge: Existing methods to remove gender bias from word embeddings are insufficient, we argue . existing methods for gender-neutral modeling are ineffective, we conclude .
Approach: They propose methods to reduce gender bias in word embeddings by debiasing them using text corpora.
Outcome: The proposed methods show that they can reduce gender bias in word embeddings . the proposed methods are insufficient and should not be trusted, the authors argue .
Mind Your Bias: A Critical Review of Bias Detection Methods for Contextual Language Models (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for detection of biases in contextual language models are inconsistent and inconclusive.
Approach: They propose to use word embedding association test to detect biases in contextual language models to compare them with other methods.
Outcome: The proposed methods are inconsistent and inconclusive for language models with word embeddings.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations