Mitigating Spurious Correlations in Text Classification Using Latent Space Geometry (2026.acl-long)
Copied to clipboard
| Challenge: | Existing models rely on predictive shortcuts that hold in training data but break under distribution shifts, leading to large performance drops for minority groups. |
| Approach: | They propose a framework that transforms abstract biases into interpretable geometric anchors without auxiliary classifiers by manipulating latent space geometry. |
| Outcome: | The proposed framework outperforms state-of-the-art baselines and improves worst-group accuracy by over 20% on the CivilComments dataset. |
Similar Papers
Decorrelate Irrelevant, Purify Relevant: Overcome Textual Spurious Correlations from a Feature Perspective (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to debiase samples with biased features obstructs the model in learning from non-biased parts of the samples. |
| Approach: | They propose to eliminate spurious correlations in a fine-grained manner from a feature space perspective by using Random Fourier Features and weighted re-sampling to decorrelate dependencies between features. |
| Outcome: | The proposed method eliminates spurious correlations in a fine-grained manner from a feature space perspective. |
Generating Data to Mitigate Spurious Correlations in Natural Language Inference Datasets (2022.acl-long)
Copied to clipboard
| Challenge: | Natural language processing models exploit spurious correlations between features and labels in datasets to perform well only within the distributions they are trained on. |
| Approach: | They propose to generate a debiased version of a dataset and replace it with training data to train a model that is generalised to different task distributions. |
| Outcome: | The proposed method outperforms or performs comparable to state-of-the-art debiasing strategies on a large suite of debiased, out-of distribution, and adversarial test sets. |
Mitigating Shortcuts in Language Models with Soft Label Encoding (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent studies have shown that large language models rely on spurious correlations in the data for natural language understanding (NLU) tasks. |
| Approach: | They propose a framework for debiasing shortcuts and a dummy class to encode shortcuts into a model and use it to generate soft labels. |
| Outcome: | The proposed framework significantly improves out-of-distribution generalization while maintaining satisfactory in-district accuracy. |
A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learning (2022.aacl-main)
Copied to clipboard
| Challenge: | Large-scale, pretrained vision-language models are growing in popularity due to impressive performance on downstream tasks with minimal finetuning. |
| Approach: | They propose to apply ranking metrics to image-text representations to investigate bias measures and debiasing methods to reduce various bias measures. |
| Outcome: | The proposed model reduces bias measures with minimal degradation to image-text representations. |
Identifying and Mitigating Spurious Correlations for Improving Robustness in NLP Models (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing work identifies task-specific shortcuts via human priors or error analyses, which requires extensive expertise and efforts. |
| Approach: | They propose to automatically identify spurious correlations in NLP models at scale by using existing interpretability methods to extract tokens that significantly affect model’s decision process. |
| Outcome: | The proposed method can identify spurious correlations in NLP models at scale and mitigate these leads to more robust models in multiple applications. |
Understanding and Mitigating Spurious Correlations in Text Classification with Neighborhood Analysis (2024.findings-eacl)
Copied to clipboard
| Challenge: | Recent research has revealed that machine learning models have a tendency to leverage spurious correlations that exist in the training set but may not hold true in general circumstances. |
| Approach: | They propose a metric to detect spurious tokens and a family of regularization methods to mitigate spurious correlations in text classification. |
| Outcome: | The proposed method prevents spurious clusters and significantly improves the robustness of classifiers without auxiliary data. |
Fighting Spurious Correlations in Text Classification via a Causal Learning Perspective (2025.naacl-long)
Copied to clipboard
| Challenge: | In text classification tasks, models often rely on spurious correlations for predictions, incorrectly associating irrelevant features with the target labels. |
| Approach: | They propose a Causally Calibrated Robust Classifier which integrates a causal feature selection method based on counterfactual reasoning and an unbiased inverse propensity weighting (IPW) loss function. |
| Outcome: | The proposed method achieves state-of-the-art performance among methods without group labels and can compete with the models that utilize group labels. |
Analyzing Biases to Spurious Correlations in Text Classification Tasks (2022.aacl-short)
Copied to clipboard
| Challenge: | Often these systems exceed human performance, but there is a caveat: standard benchmarks often assume that training and evaluation data are drawn independently and identically from the same underlying distribution. |
| Approach: | They propose to exploit spurious correlations in training data to exploit these correlations . they show that even when only ‘stop’ words are available, it is possible to predict the class significantly better than random. |
| Outcome: | The proposed model can predict class significantly better when only ‘stop’ words are available at the input stage, but can degrade the ability of the system to generalize well to out-of-domain data. |
Resampled Datasets Are Not Enough: Mitigating Societal Bias Beyond Single Attributes (2024.emnlp-main)
Copied to clipboard
Yusuke Hirota, Jerone Andrews, Dora Zhao, Orestis Papakyriakopoulos, Apostolos Modas, Yuta Nakashima, Alice Xiang
| Challenge: | Traditional approaches only target labeled attributes, ignoring biases from unlabeled ones. |
| Approach: | They propose a method that ensures protected group independence from all attributes and mitigates inpainting biases through data filtering. |
| Outcome: | The proposed approach achieves an average reduction of 46.1% in leakage-based bias metrics for multi-label classification and 74.8% for image captioning. |
CoBA: Counterbias Text Augmentation for Mitigating Various Spurious Correlations via Semantic Triples (2025.emnlp-main)
Copied to clipboard
| Challenge: | Spurious correlations are patterns that appear in datasets but do not represent genuine relationships. |
| Approach: | They propose a more general form of counterfactual data augmentation that tackles multiple biases . they propose 'CoBA' that decomposes text into subject-predicate-object triples and modifies them to disrupt spurious correlations. |
| Outcome: | The proposed framework reduces biases and strengthens out-of-distribution resilience. |