Challenge: Recent advances in neural models exploit dataset-specific patterns that do not generalize well to out-of-domain or adversarial settings.
Approach: They propose to train a model to be more robust to domain shift if it has prior knowledge of dataset biases.
Outcome: The proposed model can be more robust to domain shift if it has prior knowledge of dataset biases.

Similar Papers

Fighting Bias With Bias: Promoting Model Robustness by Amplifying Dataset Biases (2023.findings-acl)

Copied to clipboard

Challenge: Recent work sought to develop robust, unbiased models by filtering biased examples from training sets.
Approach: They propose to filter out biased examples from training sets to improve models' performance.
Outcome: The proposed evaluation framework is more challenging than the original dataset splits and even more challenging that hand-crafted challenge sets.
Towards Building More Robust NER datasets: An Empirical Study on NER Dataset Bias from a Dataset Difficulty View (2023.emnlp-main)

Copied to clipboard

Challenge: Named Entity Recognition (NER) models rely on superficial entity patterns for predictions, without considering evidence from the context.
Approach: They propose to de-bias NER datasets by altering entity-context distribution . they also validate the feasibility of the proposed de-bianking techniques .
Outcome: The proposed methods can be applied to different models and improve existing models.
Investigating Ensemble Methods for Model Robustness Improvement of Text Classifiers (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to reduce model's reliance on bias features ignore the learnability of these features.
Approach: They propose to reduce models' reliance on bias features by first training models with fixed low-capacity models which ignore the learnability of the bias features.
Outcome: The proposed models can perform better on out-of-distribution datasets than baseline models with a more sophisticated model design.
End-to-End Bias Mitigation by Modelling Biases in Corpora (2020.acl-main)

Copied to clipboard

Challenge: Recent studies have shown that strong natural language understanding models are prone to relying on unwanted dataset biases without learning the underlying task.
Approach: They propose two learning strategies to train neural models that are more robust to dataset biases and transfer better to out-of-domain datasets.
Outcome: The proposed methods improve robustness in all settings and transfer better to out-of-domain datasets.
Towards Debiasing NLU Models from Unknown Biases (2020.emnlp-main)

Copied to clipboard

Challenge: Recent proposed debiasing methods rely on the assumption that the types of bias should be known a-priori, which limits their application to many NLU tasks and datasets.
Approach: They propose a framework that prevents models from mainly utilizing biases without knowing them in advance.
Outcome: The proposed framework allows existing methods to retain performance improvement on challenge datasets without specifically targeting biases.
Learning to Model and Ignore Dataset Bias with Mixed Capacity Ensembles (2020.findings-emnlp)

Copied to clipboard

Challenge: Recent work has shown that datasets contain incidental correlations created by idiosyncrasies in the data collection process.
Approach: They propose a method that detects and ignores dataset-specific correlations by introducing a new method that makes them conditionally independent.
Outcome: The proposed method detects and ignores these kinds of dataset-specific correlations, and does not require the bias to be known in advance.
Avoiding the Hypothesis-Only Bias in Natural Language Inference via Ensemble Adversarial Training (2020.emnlp-main)

Copied to clipboard

Challenge: Neural models pick up on annotation artefacts and spurious correlations, resulting in learning sentences that suffer from the same biases.
Approach: They propose to tackle this problem by using adversarial training to reduce the bias in sentence representations by using an ensemble of adversaries.
Outcome: The proposed approach produces more robust models outperforming previous de-biasing efforts when generalised to 12 other NLI datasets.
Robust Machine Comprehension Models via Adversarial Training (N18-2)

Copied to clipboard

Challenge: Existing models for the Stanford Question Answering Dataset suffer from a 50% decrease in F1 score during adversarial evaluation based on AddSent.
Approach: They propose an alternative adversary-generation algorithm, AddSentDiverse, that significantly increases the variance within the adversarial training data by providing effective examples that punish the model for making certain superficial assumptions.
Outcome: The proposed algorithm can achieve a 36.5% increase in F1 score while maintaining performance on the regular SQuAD task.
Fact Checking Beyond Training Set (2024.naacl-long)

Copied to clipboard

Challenge: Existing fact checking systems are unsuitable for evaluating the veracity of everyday claims due to the availability of evidence resources.
Approach: They propose an adversarial algorithm to make the retriever component robust against distribution shift.
Outcome: The proposed method is insensitive to the order of claims and evidence documents.
Dataset Bias Mitigation in Multiple-Choice Visual Question Answering and Beyond (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have examined dataset biases in VQA benchmarks with short-phrase answers Multiple-choice Question with the LONG Answers (VCR, VLEP, etc.)
Approach: They propose to use Adversarial Data Synthesis (ADS) to generate synthetic training and debiased evaluation data and introduce Intra-sample Counterfactual Training (ICT) to assist models in utilizing synthesized training data.
Outcome: The proposed approach improves model performance even in domain-shifted scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations