| Challenge: | a number of machine learning models inherit and amplify the societal biases in data. |
| Approach: | a new bias detection technique based on clustering is proposed to detect local biases in data . authors propose to use LOGAN to analyze local bias in data. |
| Outcome: | The proposed technique detects bias in a local region and allows better analysis of model predictions. |
Similar Papers
Mind Your Bias: A Critical Review of Bias Detection Methods for Contextual Language Models (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for detection of biases in contextual language models are inconsistent and inconclusive. |
| Approach: | They propose to use word embedding association test to detect biases in contextual language models to compare them with other methods. |
| Outcome: | The proposed methods are inconsistent and inconclusive for language models with word embeddings. |
HERB: Measuring Hierarchical Regional Bias in Pre-trained Language Models (2022.findings-aacl)
Copied to clipboard
| Challenge: | Existing methods do not examine social groups categorised by geographical information, leaving the region-related biases in pre-trained LMs unexplored. |
| Approach: | They propose a hierarchical regional bias evaluation method to quantify regional bias in pre-trained language models. |
| Outcome: | The proposed method evaluates regional bias with regard to comprehensive topics and measures potential regional bias that can be propagated to downstream tasks. |
Are Text Classifiers Xenophobic? A Country-Oriented Bias Detection Method with Least Confounding Variables (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for detecting biases are biased because of confounding variables . authors propose a method to detect the biased classifier on any type of unlabeled data . |
| Approach: | They propose a method to detect biases of a specific fine-tuned classifier on unlabeled data. |
| Outcome: | The proposed method detects biases on unlabeled data on named entity perturbations . it uses name-entity recognition on target-domain data and morphosynctactically different languages spoken in relation to countries of the target groups . |
Balancing out Bias: Achieving Fairness Through Balanced Training (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to reducing group bias do not account for correlations between author demographics and linguistic variables, limiting their effectiveness. |
| Approach: | They extend a method for countering group bias using balanced training by balancing each demographic group in training and using protected attributes as input. |
| Outcome: | The proposed model outperforms all other methods when combined with balanced training. |
Bias and Fairness in Natural Language Processing (D19-2)
Copied to clipboard
| Challenge: | a tutorial will review the history of bias and fairness studies in machine learning and language processing . |
| Approach: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it presents recent community effort to quantify and mitigat bias in natural language processing models . |
| Outcome: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it aims to quantify and mitigate bias in natural language processing models for a wide spectrum of tasks . |
Investigating Bias in LLM-Based Bias Detection: Disparities between LLMs and Human Perception (2025.coling-main)
Copied to clipboard
| Challenge: | Detecting media bias is critical due to the spread of misinformation and disinformation on social media platforms. |
| Approach: | They investigate the presence and nature of bias within large language models and its consequential impact on media bias detection. |
| Outcome: | The proposed debiasing strategies include prompt engineering and model fine-tuning. |
On Measures of Biases and Harms in NLP (2022.findings-aacl)
Copied to clipboard
Sunipa Dev, Emily Sheng, Jieyu Zhao, Aubrie Amstutz, Jiao Sun, Yu Hou, Mattie Sanseverino, Jiin Kim, Akihiro Nishi, Nanyun Peng, Kai-Wei Chang
| Challenge: | Recent studies show that natural language processing (NLP) technologies propagate societal biases about demographic groups associated with attributes such as gender, race, and nationality. |
| Approach: | They propose a framework for harms and questions to help practitioners understand biases . they propose measurable measures to detect and mitigate biased groups . |
| Outcome: | The proposed framework provides a framework for harms and questions for practitioners to answer to guide the development of bias measures. |
Mitigating Gender Bias in Natural Language Processing: Literature Review (P19-1)
Copied to clipboard
Tony Sun, Andrew Gaut, Shirlyn Tang, Yuxin Huang, Mai ElSherief, Jieyu Zhao, Diba Mirza, Elizabeth Belding, Kai-Wei Chang, William Yang Wang
| Challenge: | NLP models propagate and may even amplify gender bias found in text corpora . methods to mitigate gender bias in NLP are relatively nascent . |
| Approach: | They propose to analyze gender bias based on four forms of representation bias and discuss the advantages and drawbacks of existing gender debiasing methods. |
| Outcome: | The proposed methods are based on four forms of representation bias and have advantages and drawbacks. |
Finspector: A Human-Centered Visual Inspection Tool for Exploring and Comparing Biases among Foundation Models (2023.acl-demo)
Copied to clipboard
| Challenge: | Existing pre-trained transformer-based language models have shown exceptional performance on various benchmarks, but hidden biases can be found within these models. |
| Approach: | They propose a human-centered visual inspection tool to detect biases in different categories through log-likelihood scores generated by language models. |
| Outcome: | The proposed tool detects biases in different categories through log-likelihood scores generated by language models. |
CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | Pretrained language models use cultural biases implicitly, causing harm . identifying and quantifying learnt biase enables us to measure progress . |
| Approach: | They propose a benchmark to measure social bias in pretrained language models . they use 1508 examples that cover stereotypes dealing with nine types of bias . |
| Outcome: | The proposed benchmark focuses on stereotypes about historically disadvantaged groups and contrasts them with advantaged groups. |