Looking at the Overlooked: An Analysis on the Word-Overlap Bias in Natural Language Inference (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for debiasing are ineffective in addressing the reverse word-overlap bias. |
| Approach: | They propose to investigate the reverse word-overlap bias in NLI models . they find that existing debiasing methods are generally ineffective . |
| Outcome: | The proposed model is biased towards the non-entailment label on instances with low overlap . the proposed model does not have minority examples, the authors show . |
Similar Papers
Avoiding the Hypothesis-Only Bias in Natural Language Inference via Ensemble Adversarial Training (2020.emnlp-main)
Copied to clipboard
| Challenge: | Neural models pick up on annotation artefacts and spurious correlations, resulting in learning sentences that suffer from the same biases. |
| Approach: | They propose to tackle this problem by using adversarial training to reduce the bias in sentence representations by using an ensemble of adversaries. |
| Outcome: | The proposed approach produces more robust models outperforming previous de-biasing efforts when generalised to 12 other NLI datasets. |
Don’t Take the Premise for Granted: Mitigating Artifacts in Natural Language Inference (P19-1)
Copied to clipboard
| Challenge: | Natural Language Inference (NLI) datasets often contain hypothesis-only biases . authors propose probabilistic methods to build models that are more robust to such artifacts - a new study shows . |
| Approach: | They propose probabilistic methods to build models that are more robust to biases . authors train on datasets containing biase . |
| Outcome: | The proposed methods can make NLI models more robust to dataset-specific artifacts . the methods transfer better than a baseline architecture in 9 out of 12 NLI datasets compared with baseline architectures based on the proposed methods . |
Towards Robustifying NLI Models Against Lexical Dataset Biases (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies show that deep learning models exploit dataset biases without deep understanding of the language semantics. |
| Approach: | They propose two methods to debiase models against lexical dataset biases . they use contradiction-word bias and word-overlapping bias as examples . |
| Outcome: | The proposed method removes label bias at embedding level, while the other uses a bag-of-words sub-model to capture features likely to exploit the bias. |
Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overview (2020.acl-main)
Copied to clipboard
| Challenge: | a growing number of studies address the effect of bias on predictions, but no unifying framework exists . a general phenomenon of biased predictive models in NLP is not recent, authors say . |
| Approach: | They propose a unifying framework for identifying and reducing bias in natural language processing . they propose to differentiate two consequences of bias and four potential origins of bias . |
| Outcome: | The proposed framework provides an overview of predictive bias in natural language processing . it differentiates two consequences of bias and four potential origins of bias: label bias, selection bias, model overamplification, and semantic bias. |
Debiasing Methods in Natural Language Understanding Make Bias More Accessible (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent debiasing methods in natural language understanding improve performance on out-of-distribution datasets by pressuring models into making unbiased predictions. |
| Approach: | They propose a general probing-based framework that allows for post-hoc interpretation of biases in language models and use an information-theoretic approach to measure the extractability of certain biase . |
| Outcome: | The proposed framework allows for post-hoc interpretation of biases in language models and measures the extractability of certain biase . |
Stubborn Lexical Bias in Data and Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent work has focused on spurious correlations between features and labels in training data . but, we find strong evidence of corresponding bias in the trained models . |
| Approach: | They propose a method to reduce spurious correlations in training data by reweighting it using a large pool of extracted features. |
| Outcome: | The proposed method reduces spurious correlations in training data, but still finds strong evidence of bias in trained models. |
Mind Your Bias: A Critical Review of Bias Detection Methods for Contextual Language Models (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for detection of biases in contextual language models are inconsistent and inconclusive. |
| Approach: | They propose to use word embedding association test to detect biases in contextual language models to compare them with other methods. |
| Outcome: | The proposed methods are inconsistent and inconclusive for language models with word embeddings. |
End-to-End Bias Mitigation by Modelling Biases in Corpora (2020.acl-main)
Copied to clipboard
| Challenge: | Recent studies have shown that strong natural language understanding models are prone to relying on unwanted dataset biases without learning the underlying task. |
| Approach: | They propose two learning strategies to train neural models that are more robust to dataset biases and transfer better to out-of-domain datasets. |
| Outcome: | The proposed methods improve robustness in all settings and transfer better to out-of-domain datasets. |
Marked Attribute Bias in Natural Language Inference (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing tests for gender-biased word embeddings do not address marked attribute bias . authors propose a new type of intrinsic bias measure for static word embeds . |
| Approach: | They propose a method to detect gender-biased word embeddings in a downstream NLP application . they propose 'debiasing' method to measure the marked attribute bias in embeddable word embeds . |
| Outcome: | The proposed method achieves best results on the marked attribute bias test set. |
HypoNLI: Exploring the Artificial Patterns of Hypothesis-only Bias in Natural Language Inference (2020.lrec-1)
Copied to clipboard
| Challenge: | Recent studies have shown that for models trained on datasets for natural language inference (NLI), it is possible to make correct predictions by looking at the hypothesis while completely ignoring the premise. |
| Approach: | They propose to derive adversarial examples in terms of the hypothesis-only bias and explore eligible ways to mitigate such bias. |
| Outcome: | The proposed models can be used to mitigate the hypothesis-only bias by using down-sampling and adversarial training. |