| Challenge: | a growing number of generative AI systems are detecting text generated by a model or written by . humans perform poorly at the detection task, but show no significant biases on the studied attributes. |
| Approach: | They examine gender, race/ethnicity, English-language learner status, and economic status . they find several models tend to classify disadvantaged groups as machine-generated . |
| Outcome: | The proposed models show strong performance but can cause negative impacts . the models classify disadvantaged groups as machine-generated, while economically disadvantaged students' essays are less likely to be classified as machine generated . |
Similar Papers
Exploring the Limitations of Detecting Machine-Generated Text (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances in the quality of the generation of text by large language models have spurred research into identifying machine-generated text. |
| Approach: | They audit classification performance for detecting machine-generated text by evaluating on texts with varying writing styles. |
| Outcome: | The proposed methods are highly sensitive to stylistic changes and complexity, and in some cases degrade entirely to random classifiers. |
Detecting Machine-Generated Text: Techniques and Challenges (2024.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial focuses on machine-generated text and deepfakes. |
| Approach: | This tutorial aims to provide a comprehensive overview of text detection techniques . it will focus on machine-generated text and deepfakes . |
| Outcome: | This tutorial focuses on machine-generated text and deepfakes. |
Automatic Detection of Machine Generated Text: A Critical Survey (2020.coling-main)
Copied to clipboard
| Challenge: | Current text generative models excel in producing text that matches the style of human language reasonably well. |
| Approach: | They conduct an in-depth error analysis of the state-of-the-art detector and discuss research directions to guide future work in this exciting area. |
| Outcome: | The proposed detectors can distinguish between human and text generated by the model and can be used to generate fake news and fake product reviews. |
Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attack (2024.lrec-main)
Copied to clipboard
| Challenge: | Despite the development of large language models, there are still significant challenges in detecting whether text is generated by a machine. |
| Approach: | They propose a framework for a broader class of adversarial attacks to perform minor perturbations in machine-generated content to evade detection. |
| Outcome: | The proposed framework can be compromised in as little as 10 seconds, and improves over iterative adversarial learning. |
Nationality Bias in Text Generation (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing studies have shown that nationality biases in language models can be a factor in improving the performance of social NLP models. |
| Approach: | They propose to use a text generation model, GPT-2, to analyze how the number of internet users and the country’s economic status affects the sentiment of stories. |
| Outcome: | The proposed model accentuates biases about country-based demonyms and reduces them with the use of adversarial triggering. |
Mind Your Bias: A Critical Review of Bias Detection Methods for Contextual Language Models (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for detection of biases in contextual language models are inconsistent and inconclusive. |
| Approach: | They propose to use word embedding association test to detect biases in contextual language models to compare them with other methods. |
| Outcome: | The proposed methods are inconsistent and inconclusive for language models with word embeddings. |
Societal Biases in Language Generation: Progress and Challenges (2021.acl-long)
Copied to clipboard
| Challenge: | Language generation techniques can produce undesirable societal biases that can negatively impact marginalized populations. |
| Approach: | They propose to examine how decoding techniques contribute to biases in language generation . they also conduct experiments to quantify the effects of these techniques . |
| Outcome: | The proposed methods can reduce biases and improve user experience, the authors argue . they also show that the proposed techniques can reduce societal biase . |
Bias and Fairness in Natural Language Processing (D19-2)
Copied to clipboard
| Challenge: | a tutorial will review the history of bias and fairness studies in machine learning and language processing . |
| Approach: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it presents recent community effort to quantify and mitigat bias in natural language processing models . |
| Outcome: | This tutorial reviews the history of bias and fairness studies in machine learning and language processing . it aims to quantify and mitigate bias in natural language processing models for a wide spectrum of tasks . |
Who Writes What: Unveiling the Impact of Author Roles on AI-generated Text Detection (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) require accurate text detection, but authors' characteristics are neglected. |
| Approach: | They investigate how author characteristics impact AI-generated text detection . they use corpus of human-authored texts and parallel AI-generated texts . |
| Outcome: | The results show that gender, CEFR proficiency, academic field and language environment influence detector accuracy. |
Are Text Classifiers Xenophobic? A Country-Oriented Bias Detection Method with Least Confounding Variables (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for detecting biases are biased because of confounding variables . authors propose a method to detect the biased classifier on any type of unlabeled data . |
| Approach: | They propose a method to detect biases of a specific fine-tuned classifier on unlabeled data. |
| Outcome: | The proposed method detects biases on unlabeled data on named entity perturbations . it uses name-entity recognition on target-domain data and morphosynctactically different languages spoken in relation to countries of the target groups . |