Challenge: Existing studies on bias dataset construction and mitigation focus on one demographic group . in real-world applications, there are more than two demographic groups at risk of the same bias.
Approach: They propose to analyze and reduce biases across multiple demographic groups using a multi-demographic bias dataset.
Outcome: The proposed method can mitigate biases among multiple demographic groups effectively, the authors show .

Similar Papers

Balancing out Bias: Achieving Fairness Through Balanced Training (2022.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to reducing group bias do not account for correlations between author demographics and linguistic variables, limiting their effectiveness.
Approach: They extend a method for countering group bias using balanced training by balancing each demographic group in training and using protected attributes as input.
Outcome: The proposed model outperforms all other methods when combined with balanced training.
Social Bias in Multilingual Language Models: A Survey (2025.emnlp-main)

Copied to clipboard

Challenge: Pretrained multilingual models exhibit the same social bias as models processing English texts.
Approach: They examine the literature on bias evaluation and mitigation approaches in multilingual and non-English contexts and identify gaps in the field.
Outcome: The proposed models perform well on multilingual language understanding benchmarks and are consistent with the current literature.
Multi-Modal Bias: Introducing a Framework for Stereotypical Bias Assessment beyond Gender and Race in Vision–Language Models (2023.eacl-main)

Copied to clipboard

Challenge: Recent advances in self-supervised training have led to a new class of pretrained vision–language models.
Approach: They propose a visual and textual bias benchmark to assess bias in self-supervised multimodal models using 3,800 images and phrases from 14 population subgroups.
Outcome: The proposed model shows that it favors certain groups while maintaining the accuracy of the model.
Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddings (N19-1)

Copied to clipboard

Challenge: Existing methods to debias word embeddings in binary settings such as gender and religion are limited to binary labels, whereas word2vec embedders can be used to propagate biases.
Approach: They propose a method to debias word embeddings in multiclass settings such as gender and religion, extending the work of Bolukbasi et al. (2016).
Outcome: The proposed method maintains the efficacy in standard NLP tasks while maintaining the utility of embeddings.
On Evaluating and Mitigating Gender Biases in Multilingual Settings (2023.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks and resources for evaluating gender biases in multilingual settings are limited.
Approach: They propose to extend DisCo to different Indian languages using human annotations to evaluate gender biases in multilingual models.
Outcome: The proposed benchmarks and mitigation techniques are extended beyond English to evaluate gender biases in multilingual models.
Comparing Biases and the Impact of Multilingual Training across Multiple Languages (2023.emnlp-main)

Copied to clipboard

Challenge: Currently, studies on bias and fairness in natural language processing focus on a single language and/or across few attributes (e.g. gender, race). However, biases can manifest differently across languages for individual attributes.
Approach: They adapt existing sentiment bias templates in English to Italian, Chinese, Hebrew, and Spanish for race, religion, nationality, and gender.
Outcome: The proposed model favors groups that are dominant in each language's culture, indicating bias amplification, after multilingual finetuning.
Leveraging Prototypical Representations for Mitigating Social Bias without Demographic Information (2024.naacl-short)

Copied to clipboard

Challenge: Existing approaches to mitigate social biases require explicit annotation of demographic information for each sample.
Approach: They propose a method that leverages predefined demographic texts and incorporates a regularization term during the fine-tuning process to mitigate bias in language models.
Outcome: The proposed method outperforms debiasing methods with limited demographic-annotated data.
Large Language Models Are Still Misled by Simple Bias Ensembles (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks for large language models are constrained to datasets where each sample is manually injected with only one type of bias.
Approach: They propose a multi-bias benchmark where each sample contains multiple types of biases.
Outcome: The proposed benchmark shows that existing LLMs and debiasing methods perform poorly on this benchmark, highlighting the challenge of eliminating compounded biases.
Multilingual Twitter Corpus and Baselines for Evaluating Demographic Bias in Hate Speech Recognition (2020.lrec-1)

Copied to clipboard

Challenge: Existing work on document classification models mainly uses synthetic monolingual data without ground truth for author demographic attributes.
Approach: They assemble and publish a multilingual Twitter corpus for the task of hate speech detection using inferred author demographic factors.
Outcome: The results show that the classifiers learn human biases and can be discriminatory towards certain demographic groups.
On Measures of Biases and Harms in NLP (2022.findings-aacl)

Copied to clipboard

Challenge: Recent studies show that natural language processing (NLP) technologies propagate societal biases about demographic groups associated with attributes such as gender, race, and nationality.
Approach: They propose a framework for harms and questions to help practitioners understand biases . they propose measurable measures to detect and mitigate biased groups .
Outcome: The proposed framework provides a framework for harms and questions for practitioners to answer to guide the development of bias measures.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations