| Challenge: | a systematic study of biases in natural language generation (NLG) is presented . a study of language models in NLG is conducted by examining language models. |
| Approach: | They propose a systematic study of biases in natural language generation by analyzing text generated from prompts that contain mentions of different demographic groups. |
| Outcome: | The proposed method reveals biases in natural language generation (NLG) by analyzing text generated from demographic prompts. |
Similar Papers
Quantifying Bias from Decoding Techniques in Natural Language Generation (2022.coling-1)
Copied to clipboard
| Challenge: | Natural language generation (NLG) models can propagate social bias towards particular demography. |
| Approach: | They propose to examine whether bias metrics like toxicity and sentiment are impacted by decoding techniques that use stochastic decoding. |
| Outcome: | The proposed methods reveal the imperative of testing inference time bias and provide evidence on the usefulness of inspecting the entire decoding spectrum. |
Bias and Fairness in Natural Language Processing (D19-2)
Copied to clipboard
| Challenge: | a tutorial will review the history of bias and fairness studies in machine learning and language processing . |
| Approach: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it presents recent community effort to quantify and mitigat bias in natural language processing models . |
| Outcome: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it aims to quantify and mitigate bias in natural language processing models for a wide spectrum of tasks . |
Towards Controllable Biases in Language Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | a new method to induce societal biases in natural language generation is being developed . a method to equalize the amount of biased text across demographics is effective . |
| Approach: | They propose a method to induce societal biases in natural language generation by using demographic inequalities. |
| Outcome: | The proposed method is effective at equalizing biases across demographics while generating less negatively biased text overall. |
Quite Good, but Not Enough: Nationality Bias in Large Language Models - a Case Study of ChatGPT (2024.lrec-main)
Copied to clipboard
| Challenge: | Nationality is a key demographic element that enhances the performance of large language models, but it has received less scrutiny regarding inherent biases. |
| Approach: | They investigated nationality bias in ChatGPT, a large language model for text generation. |
| Outcome: | The proposed model generates 4,680 discourses about nationality in Chinese and English, with 195 countries, 4 temperature settings, and 3 prompt types. |
Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets (D19-1)
Copied to clipboard
| Challenge: | Having only a few workers generate the majority of dataset examples raises concerns about data diversity . |
| Approach: | They perform a series of experiments to investigate annotator biases in recent NLU datasets . they find that models are able to recognize the most productive annotators . |
| Outcome: | The results show that models can recognize the most productive annotators and do not generalize well to examples from annotator that did not contribute to the training set. |
Nationality Bias in Text Generation (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing studies have shown that nationality biases in language models can be a factor in improving the performance of social NLP models. |
| Approach: | They propose to use a text generation model, GPT-2, to analyze how the number of internet users and the country’s economic status affects the sentiment of stories. |
| Outcome: | The proposed model accentuates biases about country-based demonyms and reduces them with the use of adversarial triggering. |
NLPositionality: Characterizing Design Biases of Datasets and Models (2023.acl-long)
Copied to clipboard
| Challenge: | Design biases in NLP systems often stem from creator’s positionality, i.e., views and lived experiences shaped by identity and background. |
| Approach: | They propose a framework for characterizing design biases and quantifying the positionality of NLP datasets and models. |
| Outcome: | The proposed framework characterizes design biases and quantifies alignment with dataset labels and model predictions. |
Towards Understanding Gender-Seniority Compound Bias in Natural Language Generation (2022.lrec-1)
Copied to clipboard
Samhita Honnavalli, Aesha Parekh, Lily Ou, Sophie Groenwold, Sharon Levy, Vicente Ordonez, William Yang Wang
| Challenge: | Existing studies have not investigated how gender biases in natural language processing (NLP) are compounded with other societal biase. |
| Approach: | They propose a framework for probing compound bias by examining seniority in pre-trained neural generation models. |
| Outcome: | The proposed framework amplifies bias by considering women as junior and men as senior more often than ground truth in both domains. |
A Tutorial on Evaluation Metrics used in Natural Language Generation (2021.naacl-tutorials)
Copied to clipboard
| Challenge: | This tutorial presents the evolution of automatic evaluation metrics to their current state along with emerging trends in this field. |
| Approach: | This tutorial presents the evolution of automatic evaluation metrics to their current state . it aims to assess the extent of scientific progress made and identify areas/components that need improvement . |
| Outcome: | This tutorial presents the evolution of automatic evaluation metrics to their current state along with emerging trends in this field. |
Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overview (2020.acl-main)
Copied to clipboard
| Challenge: | a growing number of studies address the effect of bias on predictions, but no unifying framework exists . a general phenomenon of biased predictive models in NLP is not recent, authors say . |
| Approach: | They propose a unifying framework for identifying and reducing bias in natural language processing . they propose to differentiate two consequences of bias and four potential origins of bias . |
| Outcome: | The proposed framework provides an overview of predictive bias in natural language processing . it differentiates two consequences of bias and four potential origins of bias: label bias, selection bias, model overamplification, and semantic bias. |