Comparing Intrinsic Gender Bias Evaluation Measures without using Human Annotated Examples (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods to evaluate gender biases in pre-trained language models have been limited by the cost and difficulties of recruiting human annotators. |
| Approach: | They propose a method to compare intrinsic gender bias evaluation measures without relying on human annotated examples. |
| Outcome: | The proposed method compares gender-based gender bias evaluation measures without human annotators without human input. |
Similar Papers
Evaluating Gender Bias of Pre-trained Language Models in Natural Language Inference by Considering All Labels (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to evaluate gender bias in PLMs focus on one label out of three labels, such as neutral. |
| Approach: | They propose a bias evaluation method for PLMs that considers all the three labels of NLI task and then defines a measure based on the corresponding label output. |
| Outcome: | The proposed method can distinguish biased, incorrect inferences from non-biased incorrect infertility better than baseline, resulting in a more accurate bias evaluation. |
On Evaluating and Mitigating Gender Biases in Multilingual Settings (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarks and resources for evaluating gender biases in multilingual settings are limited. |
| Approach: | They propose to extend DisCo to different Indian languages using human annotations to evaluate gender biases in multilingual models. |
| Outcome: | The proposed benchmarks and mitigation techniques are extended beyond English to evaluate gender biases in multilingual models. |
A Comparative Study of Explicit and Implicit Gender Biases in Large Language Models via Self-evaluation (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on the explicit and implicit biases in large language models (LLMs) focus on either explicit or implicit bias. |
| Approach: | They propose a self-evaluation-based two-stage measurement of explicit and implicit biases within large language models grounded in social psychology. |
| Outcome: | The proposed model is based on two stages of self-evaluation on state-of-the-art LLMs to measure explicit bias toward social targets, where bias is less likely to be self-recognized by the LLM. |
Identifying and Reducing Gender Bias in Word-Level Language Models (N19-3)
Copied to clipboard
| Challenge: | Existing discriminatory biases in training data can be amplified by models . text corpora exhibit socially problematic biase . |
| Approach: | They propose a metric to measure gender bias and a regularization loss term to minimize embeddings onto an embeddable subspace that encodes gender. |
| Outcome: | The proposed method reduces gender bias up to an optimal weight assigned to the loss term, and the model becomes unstable as the perplexity increases. |
Blind Men and the Elephant: Diverse Perspectives on Gender Stereotypes in Benchmark Datasets (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing benchmarks for measuring gender stereotypical bias in language models are inconsistencies . lack of explicit standards in data gathering can have detrimental effects on results . |
| Approach: | They propose that currently available benchmarks capture only partial facets of gender stereotypes . they apply a framework from social psychology to balance data across components of gender stereotypes based on stereotypical benchmarks. |
| Outcome: | The proposed framework improves correlation between different benchmarks by using simple balancing techniques. |
Intrinsic Bias Metrics Do Not Correlate with Application Bias (2021.acl-long)
Copied to clipboard
| Challenge: | a recent survey of bias in natural language processing found that a coreference system makes more errors in an anti-stereotypical coreferent than in a pro-sterereotype one. |
| Approach: | They compare intrinsic and extrinsic bias metrics across hundreds of trained models . they urge researchers to focus on extrindic measures of bias, not easy to measure . |
| Outcome: | a new intrinsic metric and an annotated test set on gender bias in hate speech are tested . authors urge researchers to focus on extrinsic measures of bias, and to make them more feasible . |
Collecting a Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies have found evidence of gender bias in machine translation and coreference resolution models using mostly synthetic diagnostic datasets. |
| Approach: | They propose a semi-automatic method to vastly extend synthetic, small diagnostic datasets to include grammatical patterns indicating stereotypical and non-stereotypical gender-role assignments. |
| Outcome: | The proposed method extends the existing dataset to 108K diverse English sentences. |
Unsupervised Discovery of Implicit Gender Bias (2020.emnlp-main)
Copied to clipboard
| Challenge: | Social biases are difficult to identify because human judgements in this domain can be unreliable. |
| Approach: | They propose an unsupervised approach to detecting implicit gender bias in text . their main challenge is forcing the model to focus on signs of implicit bias . |
| Outcome: | The proposed model reduces the influence of confounds by focusing on signs of implicit bias rather than other artifacts in the data. |
Explicit vs. Implicit: Investigating Social Bias in Large Language Models through Self-Reflection (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to quantify and quantify social biases in Large Language Models (LLMs) focus on explicit bias, with little attention to implicit bias. |
| Approach: | They propose a self-reflection-based evaluation framework that measures implicit bias and evaluates explicit bias by prompting LLMs to analyze their own generated content. |
| Outcome: | The proposed framework compares explicit and implicit biases in large language models . it demonstrates that explicit bias manifests as mild stereotypes, while implicit bias exhibits strong stereotypes. |
Gender Biases in Automatic Evaluation Metrics for Image Captioning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Pretrained evaluation metrics can perpetuate and amplify biases, causing inability to differentiate between biased and unbiased generations. |
| Approach: | They conduct a systematic study of gender biases in image captioning tasks . they show that pretrained models perpetuate and amplify biase . |
| Outcome: | The proposed model-based evaluation metrics have shown good correlations with human judgments in language generation tasks. |