| Challenge: | Instruction-Following Language Models (IFLMs) are promising and versatile tools for solving many downstream, information-seeking tasks. |
| Approach: | They propose a resource to test whether IFLMs are prone to biases . they cast WEAT word tests in promptized classification tasks and associate a metric - the bias score . |
| Outcome: | The proposed resource consists of 2310 prompts and tests gender and race biases in all the analyzed models. |
Similar Papers
On Measuring Social Biases in Prompt-Based Multi-Task Learning (2022.findings-naacl)
Copied to clipboard
| Challenge: | a large body of work within prompt engineering attempts to understand the effects of input forms and prompts in achieving superior performance. |
| Approach: | They propose a large-scale text-to-text language model trained using prompts . they consider two different forms of semantically equivalent inputs - question-answer format and premise-hypothesis format . |
| Outcome: | The proposed model can generalize into novel forms of language and handle novel tasks. |
This prompt is measuring <mask>: evaluating bias evaluation in language models (2023.findings-acl)
Copied to clipboard
| Challenge: | a growing body of work uses prompts and templates to assess bias in language models . authors examine the scope of possible bias types and identify those under-researched . |
| Approach: | They draw on a measurement modelling framework to create a bias taxonomy . they show that bias tests are often unstated or ambiguous, carry implicit assumptions . |
| Outcome: | The proposed taxonomy shows that bias tests are often unstated or ambiguous . the analysis illuminates the scope of possible bias types the field can measure . |
Social Bias Evaluation for Large Language Models Requires Prompt Variations (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have tried to evaluate and mitigate social biases accurately using limited prompts. |
| Approach: | They investigate the sensitivity of Large Language Models when changing prompt variations . they found that LLM rankings fluctuate across prompts for both task performance and social bias . |
| Outcome: | The results show that LLM rankings fluctuate when changing prompt variations . |
Bias in Language Models: Beyond Trick Tests and Towards RUTEd Evaluation (2025.acl-long)
Copied to clipboard
| Challenge: | Standard bias benchmarks are used for large language models to measure the association between social attributes and single-word outputs. |
| Approach: | They adapt three standard bias metrics of next-word prediction to measure gender-occupation bias and develop an analogous RUTEd evaluation in three contexts of real-world LLM use. |
| Outcome: | The proposed benchmarks are robust to lengthening model outputs via a more realistic user prompt in the domain of gender-occupation bias. |
From Word to World: Evaluate and Mitigate Culture Bias in LLMs via Word Association Test (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multilingual and cross-cultural WAT reveal how culture modulates perceptual and interactive patterns. |
| Approach: | They propose to embed cultural-specific semantic associations directly within large language models (LLMs) to address cultural preference. |
| Outcome: | The proposed model significantly improves cross-cultural alignment, capturing diverse semantic associations. |
Rethinking Prompt-based Debiasing in Large Language Model (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing prompt-based methods for debiasing are often superficial and lack a thorough understanding of complex bias concepts. |
| Approach: | They analyze a BBQ and stereoSet benchmarks to examine the assumption that large language models understand biases. |
| Outcome: | The proposed model misclassified 90% of unbiased content as biased despite high accuracy on BBQ dataset . the proposed model may have been flawed in previous attempts to debiase . |
Adaptive Prompting: Ad-hoc Prompt Composition for Social Bias Detection (2025.naacl-long)
Copied to clipboard
Maximilian Spliethöver, Tim Knebler, Fabian Fumagalli, Maximilian Muschalik, Barbara Hammer, Eyke Hüllermeier, Henning Wachsmuth
| Challenge: | Existing prompting techniques for large language models depend on several parameters, such as the task, language model, and context provided. |
| Approach: | They propose an adaptive prompting approach that predicts the optimal prompt composition ad-hoc for a given input. |
| Outcome: | The proposed approach ensures high detection performance and is best in several settings. |
Mind the Biases: Quantifying Cognitive Biases in Language Model Prompting (2023.findings-acl)
Copied to clipboard
| Challenge: | Cognitive biases in the human decision making process can lead to flawed responses when we are under uncertainty. |
| Approach: | They propose to expose cognitive biases on results of language model prompting which display bias modes resembling cognitive bias. |
| Outcome: | The proposed methods show that a toning-down transformation of the drug-drug description in a prompt can elicit a bias similar to the framing effect, warning users to distrust when prompting language models for answers. |
In-Depth Look at Word Filling Societal Bias Measures (2023.eacl-main)
Copied to clipboard
| Challenge: | Language models (LMs) are ubiquitous in current NLP and have brought undeniable performance improvements for many tasks. |
| Approach: | They propose to use word filling prompts to evaluate language models' behavior to find out if they are valid. |
| Outcome: | The proposed measures produce unexpected and illogical results when appropriate control group samples are constructed. |
Probing Toxic Content in Large Pre-Trained Language Models (2021.acl-long)
Copied to clipboard
| Challenge: | Existing studies on pre-trained language models have shown that they carry harmful biases towards different social groups. |
| Approach: | They propose a method to probe English, French, and Arabic PTLMs and quantify the potentially harmful content they convey with respect to a set of templates. |
| Outcome: | The proposed method analyzes PTLMs to predict masked tokens at the end of sentences to assess their toxicity. |