Challenge: Existing work on societal bias in NLP focuses on race and gender . linguistic background is a unique attribute that has been largely ignored in the field .
Approach: They examine linguistic background to craft plausible adversarial examples that expose biases in popular NLP models.
Outcome: The proposed model improves robustness without sacrificing performance on clean data.

Similar Papers

Perturbation Augmentation for Fairer NLP (2022.emnlp-main)

Copied to clipboard

Challenge: Unwanted and often harmful social biases are becoming more salient in NLP research.
Approach: They propose to train a neural perturbation model that rewrites demographic references in text to make them more fair.
Outcome: The proposed model outperforms heuristic alternatives on a large dataset of human annotated text perturbations.
Model Internal Sleuthing: Finding Lexical Identity and Inflectional Features in Modern Language Models (2026.acl-long)

Copied to clipboard

Challenge: Prior work suggests hierarchical organization where different layers specialize in capturing distinct levels of linguistic structure.
Approach: They probe 25 models from BERT Base to Qwen2.5-7B focusing on linguistic properties: lexical identity and inflectional features.
Outcome: The proposed model maintains inflectional features across layers while trading off lexical identity for compact, predictive representations.
Do Neural Language Models Overcome Reporting Bias? (2020.coling-main)

Copied to clipboard

Challenge: Recent studies show that pre-trained language models can overcome reporting bias by estimating the plausibility of rare but unspoken facts.
Approach: They revisit the experiments conducted by Gordon and Van Durme (2013) . they find that pre-trained language models overestimate the very rare .
Outcome: The proposed approach overestimates the rare at the expense of the rare, while minimizing reporting bias.
Impact of Adversarial Training on Robustness and Generalizability of Language Models (2023.findings-acl)

Copied to clipboard

Challenge: Adversarial training is widely acknowledged as the most effective defense against adversarial attacks, but achieving both robustness and generalization requires a trade-off.
Approach: They propose to compare pre-training data augmentation and training time input perturbations with embedding space perturbations to find out whether they improve generalization.
Outcome: The proposed methods improve generalization and robustness of the trained models.
Morphological Inflection: A Reality Check (2023.acl-long)

Copied to clipboard

Challenge: Morphological inflection is a popular task in sub-word NLP with practical and cognitive applications.
Approach: They propose new methods to analyze data sets and evaluate their generalization abilities to better reflect likely use-cases.
Outcome: The proposed methods improve generalizability and reliability of results and improve generalization abilities.
Is a Document Educational or Just Wikipedia-Style? — Pitfalls of Classifier-Based Quality Filtering (2026.acl-short)

Copied to clipboard

Challenge: Large Language Models (LLMs) are pre-trained on massive data corpora, and the quality of these corporales is one of the main factors in achieving stateof-the-art performance.
Approach: They propose to use Wikipedia-style reformatting to alter a model's quality assessment and enable low-quality content to surpass filtering thresholds.
Outcome: The proposed model would reverse filtering decision for approximately 7% of evaluated documents, thereby admitting content into the pre-training corpus that would otherwise have been excluded.
From Prejudice to Parity: A New Approach to Debiasing Large Language Model Word Embeddings (2025.coling-main)

Copied to clipboard

Challenge: Existing work in this field has looked most commonly into gender bias, racial bias, and religious bias.
Approach: They propose an algorithm that uses a neural network to perform ‘soft debiasing’ and build on the seminal work of (CITATION) and (CitATION).
Outcome: The proposed algorithm outperforms current methods on gender, race, and religion metrics on a wide range of metrics.
A Comparison between Pre-training and Large-scale Back-translation for Neural Machine Translation (2021.findings-acl)

Copied to clipboard

Challenge: BERT is a promising technique to improve NMT, but how it outperforms standard NMT is understudied.
Approach: We compare MT engines trained with pre-trained BERT and back-translation with incrementally larger amounts of data.
Outcome: The proposed technique outperforms standard NMT models on morphology and syntax.
Robustness and Adversarial Examples in Natural Language Processing (2021.emnlp-tutorials)

Copied to clipboard

Challenge: This tutorial aims to raise awareness of practical concerns about NLP robustness . it aims at addressing the weaknesses of NLP systems when faced with adversarial inputs and data with a distribution shift .
Approach: This tutorial aims to bring awareness of practical concerns about NLP robustness . it reviews recent studies on analyzing the weakness of NLP systems when facing adversarial inputs .
Outcome: This tutorial aims to bring awareness of practical concerns about NLP robustness . it will examine the weaknesses of NLP systems when faced with adversarial inputs and data with a distribution shift .
End-to-End Bias Mitigation by Modelling Biases in Corpora (2020.acl-main)

Copied to clipboard

Challenge: Recent studies have shown that strong natural language understanding models are prone to relying on unwanted dataset biases without learning the underlying task.
Approach: They propose two learning strategies to train neural models that are more robust to dataset biases and transfer better to out-of-domain datasets.
Outcome: The proposed methods improve robustness in all settings and transfer better to out-of-domain datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations