Papers by Bufan Gao
Measuring Bias or Measuring the Task: Understanding the Brittle Nature of LLM Gender Biases (2025.emnlp-main)
Copied to clipboard
| Challenge: | a growing number of efforts to measure and mitigate gender bias have focused on task prompts that overtly or covertly signal the presence of gender bias-related content. |
| Approach: | They examine how signaling the evaluative purpose of a task impacts measured gender bias in LLMs. |
| Outcome: | The proposed models show that prompts that align with (gender bias) evaluation framing elicit distinct gender output distributions compared to less evaluation-framed prompts. |