Challenge: Existing approaches to mitigate the detrimental effect of bias on the network include debiasing methods that down-weight the biased examples identified by an auxiliary model, which is trained with explicit bias labels.
Approach: They propose a framework that introduces binary classifiers between the auxiliary model and main model, coined bias experts, to reduce the detrimental effect of bias on the network.
Outcome: The proposed approach outperforms the state-of-the-art on various datasets while achieving high performance on in-distribution data.

Similar Papers

End-to-End Bias Mitigation by Modelling Biases in Corpora (2020.acl-main)

Copied to clipboard

Challenge: Recent studies have shown that strong natural language understanding models are prone to relying on unwanted dataset biases without learning the underlying task.
Approach: They propose two learning strategies to train neural models that are more robust to dataset biases and transfer better to out-of-domain datasets.
Outcome: The proposed methods improve robustness in all settings and transfer better to out-of-domain datasets.
When and Why Does Bias Mitigation Work? (2023.findings-emnlp)

Copied to clipboard

Challenge: Neural models exploit shallow surface features to perform language understanding tasks, rather than learning the deeper language understanding and reasoning skills that practitioners desire.
Approach: They propose to use model debiasing techniques to pressure models away from spurious features and to use them to learn useful representations instead.
Outcome: The proposed methods increase models' reliance on hidden biases instead of learning robust features that help them solve a task.
Avoiding the Hypothesis-Only Bias in Natural Language Inference via Ensemble Adversarial Training (2020.emnlp-main)

Copied to clipboard

Challenge: Neural models pick up on annotation artefacts and spurious correlations, resulting in learning sentences that suffer from the same biases.
Approach: They propose to tackle this problem by using adversarial training to reduce the bias in sentence representations by using an ensemble of adversaries.
Outcome: The proposed approach produces more robust models outperforming previous de-biasing efforts when generalised to 12 other NLI datasets.
Unlabeled Debiasing in Downstream Tasks via Class-wise Low Variance Regularization (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for debiasing depend on attribute labels and target attributes.
Approach: They propose a method that uses class-wise variance of embeddings to reduce the effects of debiasing on a downstream task.
Outcome: The proposed method outperforms baselines that rely on attribute labels while maintaining performance on the target task.
An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models (2022.acl-long)

Copied to clipboard

Challenge: Recent work has shown pre-trained language models capture social biases from the large amounts of text they are trained on.
Approach: They propose to use Counterfactual Data Augmentation, Dropout, Iterative Nullspace Projection, Self-Debias, and SentenceDebia as bias mitigation techniques to quantify their effectiveness.
Outcome: The proposed techniques are Counterfactual Data Augmentation (CDA), Dropout, Iterative Nullspace Projection, Self-Debias, and SentenceDebia.
End-to-End Self-Debiasing Framework for Robust NLU Training (2021.findings-acl)

Copied to clipboard

Challenge: Existing models incorporate dataset biases leading to strong performance on in-distribution test sets but poor performance on out-of-distortion (OOD) tests.
Approach: They propose a debiasing framework where the shallow representations of the main model are used to derive a bias model and both models are trained simultaneously.
Outcome: The proposed framework outperforms existing approaches on three well-studied NLU tasks while still delivering high in-distribution performance.
Towards Robustifying NLI Models Against Lexical Dataset Biases (2020.acl-main)

Copied to clipboard

Challenge: Recent studies show that deep learning models exploit dataset biases without deep understanding of the language semantics.
Approach: They propose two methods to debiase models against lexical dataset biases . they use contradiction-word bias and word-overlapping bias as examples .
Outcome: The proposed method removes label bias at embedding level, while the other uses a bag-of-words sub-model to capture features likely to exploit the bias.
Towards Debiasing NLU Models from Unknown Biases (2020.emnlp-main)

Copied to clipboard

Challenge: Recent proposed debiasing methods rely on the assumption that the types of bias should be known a-priori, which limits their application to many NLU tasks and datasets.
Approach: They propose a framework that prevents models from mainly utilizing biases without knowing them in advance.
Outcome: The proposed framework allows existing methods to retain performance improvement on challenge datasets without specifically targeting biases.
Guide the Learner: Controlling Product of Experts Debiasing Method Based on Token Attribution Similarities (2023.eacl-main)

Copied to clipboard

Challenge: Several proposals have been put forward for improving out-of-distribution performance by mitigating dataset biases.
Approach: They propose a fine-tuning strategy that incorporates the similarity between the main and biased model attribution scores in a Product of Experts (PoE) loss function to further improve OOD performance.
Outcome: The proposed method improves OOD performance while maintaining in-distribution performance.
Mind the Trade-off: Debiasing NLU Models without Degrading the In-distribution Performance (2020.acl-main)

Copied to clipboard

Challenge: Recent studies show that pre-trained language models rely heavily on idiosyncratic biases of datasets.
Approach: They propose a method which discourages models from exploiting biases while enabling them to receive enough incentive to learn from all the training examples.
Outcome: The proposed method improves on out-of-distribution datasets while maintaining original in-district accuracy.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations