Identifying and Mitigating Social Bias Knowledge in Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for debiasing may generate incorrect or nonsensical predictions but leave aside individual commonsense facts, resulting in modified knowledge that elicits unreasonable or undesired predictions. |
| Approach: | They propose a framework that identifies encoding locations of biases within language models and then applies the Fairness-Stamp (FAST) they also propose 'BiaScope' to evaluate the retention of commonsense knowledge and generalization across paraphrased social biase. |
| Outcome: | The proposed framework surpasses state-of-the-art baselines with superior debiasing performance while not compromising the overall model capability for knowledge retention and prediction. |
Similar Papers
Debiasing Large Language Models with Structured Knowledge (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to reduce biases in pre-training models are hampered by their performance. |
| Approach: | They propose a method that utilizes structured knowledge to mitigate bias in LLMs . their method obviates the need for training from scratch, thus offering enhanced scalability . |
| Outcome: | The proposed method outperforms state-of-the-art (SOTA) baselines in the debiasing ability. |
Data-Centric Explainable Debiasing for Improving Fairness in Pre-trained Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing data-centric debiasing strategies mainly leverage explicit bias words for counterfactual data augmentation to balance the training data. |
| Approach: | They propose a method which uses an explainability method to search for implicit bias words to assist in debiasing PLMs. |
| Outcome: | Extensive results show that the proposed method achieves state-of-the-art debiasing performance and strong generalization while maintaining predictive abilities. |
Bias and Fairness in Natural Language Processing (D19-2)
Copied to clipboard
| Challenge: | a tutorial will review the history of bias and fairness studies in machine learning and language processing . |
| Approach: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it presents recent community effort to quantify and mitigat bias in natural language processing models . |
| Outcome: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it aims to quantify and mitigate bias in natural language processing models for a wide spectrum of tasks . |
BiasFilter: An Inference-Time Debiasing Framework for Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for debiasing large language models incur high human and computational costs and are limited in their effectiveness. |
| Approach: | They propose a model-agnostic, inference-time debiasing framework that enforces fairness by filtering generation outputs in real time. |
| Outcome: | The proposed framework mitigates social bias across a range of LLMs while preserving overall generation quality. |
Mitigate Extrinsic Social Bias in Pre-trained Language Models via Continuous Prompts Adjustment (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods of extrinsic bias mitigation rely on manual word lists for sensitive groups . however, these word lists are limited by length and scope, resulting in poor performance. |
| Approach: | They propose a method which generates continuous token lists from the entire vocabulary space and uses them to bridge the gap between outputs and targets in fairness learning process. |
| Outcome: | The proposed method outperforms baseline methods on three NLU tasks. |
DeFrame: Debiasing Large Language Models Against Framing Effects (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing debiasing methods improve overall fairness, but fail to reduce framing-induced disparities. |
| Approach: | They propose a framing-aware debiasing method that encourages LLMs to be more consistent across frams. |
| Outcome: | The proposed method reduces overall bias and improves robustness against framing disparities, enabling LLMs to produce fairer and more consistent responses. |
From Prejudice to Parity: A New Approach to Debiasing Large Language Model Word Embeddings (2025.coling-main)
Copied to clipboard
| Challenge: | Existing work in this field has looked most commonly into gender bias, racial bias, and religious bias. |
| Approach: | They propose an algorithm that uses a neural network to perform ‘soft debiasing’ and build on the seminal work of (CITATION) and (CitATION). |
| Outcome: | The proposed algorithm outperforms current methods on gender, race, and religion metrics on a wide range of metrics. |
Fairness Evaluation and Inference Level Mitigation in LLMs (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models display undesirable behaviors embedded in their internal representations, undermining fairness, inconsistency drift, and the propagation of unwanted patterns during extended dialogues. |
| Approach: | They propose a pruning-based framework that detects context-aware neuron activations and applies adaptive masking to modulate their influence during generation. |
| Outcome: | The proposed framework detects context-aware neuron activations and applies adaptive masking to modulate their influence during generation. |
Social Bias Probing: Fairness Benchmarking for Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for evaluating social biases in language models have been limited to binary association tests on small datasets. |
| Approach: | They propose a framework for probing language models for social biases by assessing disparate treatment . they use a large-scale benchmark to examine the diversity of identities and stereotypes . |
| Outcome: | The proposed framework expands the analysis beyond the binary comparison of stereotypical versus anti-stereotypical identities to include a diverse range of identities and stereotypes. |
Confronting LLMs with Traditional ML: Rethinking the Fairness of Large Language Models in Tabular Classifications (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent studies suggest using large language models to make tabular classifications . however, LLMs have been shown to exhibit harmful social biases based on stereotypes and inequalities present in society. |
| Approach: | They propose to use large language models to make tabular classifications . they show that LLMs inherit biases from their training data . |
| Outcome: | The proposed models exhibit harmful biases that reflect stereotypes and inequalities in society. |