Challenge: In real-world machine learning systems, labels are often derived from user behaviors that the system wishes to encourage.
Approach: They propose a method for correcting presentation bias using generated counterfactual labels by augmentation of the labels by the user.
Outcome: The proposed method improves performance in an oracle setting compared to uncorrected models and existing bias-correction methods.

Similar Papers

Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysis (2021.acl-long)

Copied to clipboard

Challenge: Existing approaches to improve performance of deep neural models are limited by the nature of spurious patterns in the data.
Approach: They propose to use augmented data to generate spurious patterns in NLP models . they propose to generate counterfactual data for data augmentation and explanation .
Outcome: The proposed approach improves performance on augmented data and on human-generated data.
Improving Classifier Robustness through Active Generative Counterfactual Data Augmentation (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing methods for finding meaningful counterfactuals rely on human annotation or implicit label invariance . a small amount of human-annotated counterf actual data can generate a robust dataset with learned labels.
Approach: They propose a framework that generates counterfactuals by actively sampling from regions of uncertainty and automatically labeling them with a learned auxiliary classifier.
Outcome: The proposed framework generates a large number of diverse counterfactuals and labels them with a learned classifier.
Counterfactual Generator: A Weakly-Supervised Method for Named Entity Recognition (2020.emnlp-main)

Copied to clipboard

Challenge: Using labeled data, named entity recognition is labor-intensive, time-consuming and expensive.
Approach: They propose a method which decomposes named entity into two parts: entity and context.
Outcome: The proposed method improves the generalization ability of models under limited observational examples.
NeuroCounterfactuals: Beyond Minimal-Edit Counterfactuals for Richer Data Augmentation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to produce counterfactuals rely on small perturbations via minimal edits, resulting in simplistic changes.
Approach: They propose a novel approach to produce counterfactuals that allow for larger edits and linguistic diversity while still bearing similarity to the original document.
Outcome: The proposed approach outperforms existing methods for generalizing natural language models under select settings.
What if This Modified That? Syntactic Interventions with Counterfactual Embeddings (2021.findings-acl)

Copied to clipboard

Challenge: Prior art aims to uncover meaningful properties within model representations, but it is unclear how faithfully such probes portray information that the models actually use.
Approach: They propose a technique for generating counterfactual embeddings within models . they produce evidence that some models use a tree-distancelike representation of syntax .
Outcome: The proposed technique produces evidence that some models use tree-distancelike representations of syntax in downstream prediction tasks.
Dually Self-Improved Counterfactual Data Augmentation Using Large Language Model (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to generate counterfactual data augmentation are limited due to imbalance and biases in real-world training data.
Approach: They propose a self-improved method for generating high-quality counterfacts using large language models.
Outcome: The proposed method generates high-quality counterfacts on the natural language inference task using lightweight and task-specific LLMs.
CoBA: Counterbias Text Augmentation for Mitigating Various Spurious Correlations via Semantic Triples (2025.emnlp-main)

Copied to clipboard

Challenge: Spurious correlations are patterns that appear in datasets but do not represent genuine relationships.
Approach: They propose a more general form of counterfactual data augmentation that tackles multiple biases . they propose 'CoBA' that decomposes text into subject-predicate-object triples and modifies them to disrupt spurious correlations.
Outcome: The proposed framework reduces biases and strengthens out-of-distribution resilience.
DISCO: Distilling Counterfactuals with Large Language Models (2023.acl-long)

Copied to clipboard

Challenge: high-quality counterfactual data is scarce for most tasks and not easily generated at scale.
Approach: They propose a method for automatically generating high-quality counterfactual data at scale . they use a large general language model to generate phrasal perturbations and filter them .
Outcome: The proposed method is task-agnostic and can be applied to the task of natural language inference.
Counterfactual Inference for Text Classification Debiasing (2021.acl-long)

Copied to clipboard

Challenge: Existing methods to capture unintended dataset biases are expensive and require elaborate balancing strategies.
Approach: They propose a model-agnostic text classification debiasing framework which can effectively avoid employing data manipulations or designing balancing mechanisms.
Outcome: The proposed framework can effectively avoid data manipulations or designing balancing mechanisms to capture unintended dataset biases.
Diffusion Based Counterfactual Augmentation for Dual Sentiment Classification (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods to augment sentiment models have failed to mitigate spurious association problem inherent in the original data.
Approach: They propose a framework for enhancing sentiment models using an antonymous paradigm and contrastive learning to generate high-quality samples.
Outcome: The proposed framework achieves state-of-the-art performance on four benchmark datasets.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations