Born Differently Makes a Difference: Counterfactual Study of Bias in Biography Generation from a Data-to-Text Perspective (2024.acl-short)
Copied to clipboard
| Challenge: | Current research shows that biographies reflect bias from society such as gender and religions. |
| Approach: | They propose a method that manipulates the personal attributes of interest while keeping the co-occurring attributes unchanged. |
| Outcome: | The proposed method expands the analysis of gender-centered bias in text generation. |
Similar Papers
Generating Biographies on Wikipedia: The Impact of Gender Bias on the Retrieval-Based Generation of Women Biographies (2022.acl-long)
Copied to clipboard
| Challenge: | Existing efforts to encourage article creation focus on reducing the gender gap in Wikipedia articles. |
| Approach: | They propose a model that retrieves web evidence and generates biographies section by section . they analyze available web evidence to determine the accuracy of the generated text . |
| Outcome: | The proposed model can generate biographies section by section, including citation information, using retrieval mechanisms and a cache-based pre-trained encoder-decoder. |
Biased Tales: Cultural and Topic Bias in Generating Children’s Stories (2025.emnlp-main)
Copied to clipboard
| Challenge: | Personalized stories are often preferred because they reflect a child's interests, experiences, and developmental needs. |
| Approach: | They analyze a dataset to examine how biases influence protagonists’ attributes and story elements in LLM-generated stories. |
| Outcome: | The proposed dataset shows that gender stereotypes influence protagonist attributes and story elements in LLM-generated stories. |
Detecting Independent Pronoun Bias with Partially-Synthetic Data Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | linguistic differences between English pronouns that are not inherently biased can become biases in some machine learning models. |
| Approach: | They propose a method to detect bias by alternating pronouns in different contexts. |
| Outcome: | The proposed method can be used to detect bias in language models and for text generation more broadly. |
COFFEE: Counterfactual Fairness for Personalized Text Generation in Explainable Recommendation (2023.emnlp-main)
Copied to clipboard
Nan Wang, Qifan Wang, Yi-Chia Wang, Maziar Sanjabi, Jingzhou Liu, Hamed Firooz, Hongning Wang, Shaoliang Nie
| Challenge: | Personalized text generation (PTG) is a key component of our digital lives but can inadvertently associate different levels of linguistic quality with users’ protected attributes. |
| Approach: | They propose a framework to achieve measure-specific counterfactual fairness in explanation generation by focusing on one of the most studied settings: generating natural language explanations for recommendations. |
| Outcome: | The proposed framework achieves measure-specific counterfactual fairness in explanation generation. |
MirrorStories: Reflecting Diversity through Personalized Narrative Generation with Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are used to create personalized “mirror stories” that reflect and resonate with individual readers’ identities. |
| Approach: | They propose to use Large Language Models to create personalized “mirror stories” that reflect and resonate with individual readers’ identities. |
| Outcome: | The proposed models outperform generic human-written and LLM-generated narratives on all metrics of engagement and textual diversity while preserving the intended moral. |
Bias Beyond English: Counterfactual Tests for Bias in Sentiment Analysis in Four Languages (2023.findings-acl)
Copied to clipboard
| Challenge: | Sentiment analysis systems are used in hundreds of products and languages . Gender and racial biases are well-studied in English, but understudied elsewhere . |
| Approach: | They build a counterfactual evaluation corpus for gender and racial/migrant bias in four languages. |
| Outcome: | The evaluation corpus reveals which models have less bias and pinpoints changes in model bias behaviour, enabling more targeted mitigation strategies. |
Reducing Sentiment Bias in Language Models via Counterfactual Evaluation (2020.findings-emnlp)
Copied to clipboard
Po-Sen Huang, Huan Zhang, Ray Jiang, Robert Stanforth, Johannes Welbl, Jack Rae, Vishal Maini, Dani Yogatama, Pushmeet Kohli
| Challenge: | Language modeling has advanced rapidly due to efficient model architectures and the availability of large text corpora. |
| Approach: | They propose to embed and regularize sentiment prediction-derived regularizations on the language model’s latent representations to reduce bias in the sentiment of generated text. |
| Outcome: | The proposed methods reduce bias in the sentiment of generated text by adopting individual and group fairness metrics from the fair machine learning literature. |
How Quantization Shapes Bias in Large Language Models (2026.eacl-long)
Copied to clipboard
| Challenge: | a systematic review of quantization's effects on model biases focuses on stereotypes, fairness, toxicity, and sentiment. |
| Approach: | They focus on weight and activation quantization strategies and examine their effects across bias types including stereotypes, fairness, toxicity, and sentiment. |
| Outcome: | The proposed method can reduce stereotypes and unfairness, but it tends to increase stereotypes in generative tasks. |
Uncovering Implicit Gender Bias in Narratives through Commonsense Inference (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models learn harmful biases from their training corpora and may repeat these biase if used for generation. |
| Approach: | They focus on gender biases associated with the protagonist in model-generated stories and use a commonsense reasoning engine to uncover them. |
| Outcome: | The proposed model-generated stories are based on a commonsense reasoning engine and are able to uncover gender biases in the protagonist's motivations, attributes, mental states, and implications on others. |
GRAVITY: A Framework for Personalized Text Generation via Profile-Grounded Synthetic Preferences (2026.eacl-long)
Copied to clipboard
| Challenge: | Personalization in LLMs often relies on costly human feedback or interaction logs, limiting scalability and neglecting deeper user attributes. |
| Approach: | They propose a framework for generating synthetic, profile-grounded preference data that captures users’ interests, values, beliefs, and personality traits. |
| Outcome: | The proposed framework improves on book descriptions for 400 Amazon users across multiple cultures, with user studies showing that outputs are preferred over 86% of the time. |