NeuroCounterfactuals: Beyond Minimal-Edit Counterfactuals for Richer Data Augmentation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to produce counterfactuals rely on small perturbations via minimal edits, resulting in simplistic changes. |
| Approach: | They propose a novel approach to produce counterfactuals that allow for larger edits and linguistic diversity while still bearing similarity to the original document. |
| Outcome: | The proposed approach outperforms existing methods for generalizing natural language models under select settings. |
Similar Papers
Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysis (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to improve performance of deep neural models are limited by the nature of spurious patterns in the data. |
| Approach: | They propose to use augmented data to generate spurious patterns in NLP models . they propose to generate counterfactual data for data augmentation and explanation . |
| Outcome: | The proposed approach improves performance on augmented data and on human-generated data. |
CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work on counterfactual data augmentation only considered restricted classes of perturbations, limiting their effectiveness. |
| Approach: | They propose a retrieval-augmented framework for creating diverse counterfactual perturbations for CDA. |
| Outcome: | Experiments on natural language inference and sentiment analysis show that the proposed framework can be used to encourage diversity in manually authored perturbations. |
Counterfactuals of Counterfactuals: a back-translation-inspired approach to analyse counterfactual editors (2023.findings-acl)
Copied to clipboard
George Filandrianos, Edmund Dervakos, Orfeas Menis Mastromichalakis, Chrysoula Zerva, Giorgos Stamou
| Challenge: | Existing explanations for classifiers are counterfactual or contrastive . lack of universal ground truth for counterf actual edits hinders their evaluation . |
| Approach: | They propose a back translation-inspired evaluation methodology that utilises earlier outputs of the explainer as ground truth proxies to investigate the consistency of explainers. |
| Outcome: | The proposed method can provide valuable insights into the behaviour of predictor and explainer models and infer patterns that would otherwise be obscured. |
Parallel Universes, Parallel Languages: A Comprehensive Study on LLM-based Multilingual Counterfactual Example Generation (2026.acl-long)
Copied to clipboard
Qianli Wang, Van Bach Nguyen, Yihong Liu, Fedor Splitt, Nils Feldhus, Christin Seifert, Hinrich Schuetze, Sebastian Möller, Vera Schmitt
| Challenge: | Large language models excel at generating English counterfactuals but their effectiveness in generating multilingual counterfacts remains unclear. |
| Approach: | They conduct automatic evaluations on both directly generated and derived counterfactuals in six languages and find that cross-lingual perturbations follow common strategic principles. |
| Outcome: | The proposed models show that translation-based counterfactuals offer higher validity than their directly generated counterparts, but still fall short of matching the quality of the original English counterf actuals. |
LLMs for Generating and Evaluating Counterfactuals: A Comprehensive Study (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown remarkable performance in NLP tasks, but their efficacy in generating high-quality CFs remains uncertain. |
| Approach: | They compare LLMs' ability to generate CFs that flip the original label and human CF's. |
| Outcome: | The proposed models generate fluent CFs, but struggle to keep the induced changes minimal. |
A Survey on Natural Language Counterfactual Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in NLP are driven by a variety of Large Language Models (LLMs), such as GPT-3 (175B) and PaLM (540B). |
| Approach: | They propose a taxonomy that categorizes the methods into four groups and summarizes the metrics for evaluating the generation quality. |
| Outcome: | The proposed taxonomy categorizes the generation methods into four groups and summarizes the metrics for evaluating the quality. |
Dually Self-Improved Counterfactual Data Augmentation Using Large Language Model (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to generate counterfactual data augmentation are limited due to imbalance and biases in real-world training data. |
| Approach: | They propose a self-improved method for generating high-quality counterfacts using large language models. |
| Outcome: | The proposed method generates high-quality counterfacts on the natural language inference task using lightweight and task-specific LLMs. |
EXPLAIN, EDIT, GENERATE: Rationale-Sensitive Counterfactual Data Augmentation for Multi-hop Fact Verification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to augment training data with counterfactuals fail to handle multi-hop fact verification due to their incapability to preserve complex logical relationships. |
| Approach: | They propose to augment training data with counterfactuals that alter causal features of the original data by preserving logical relationships. |
| Outcome: | The proposed method outperforms the baselines and can generate linguistically diverse counterfactuals without disrupting their logical relationships. |
Improving Classifier Robustness through Active Generative Counterfactual Data Augmentation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for finding meaningful counterfactuals rely on human annotation or implicit label invariance . a small amount of human-annotated counterf actual data can generate a robust dataset with learned labels. |
| Approach: | They propose a framework that generates counterfactuals by actively sampling from regions of uncertainty and automatically labeling them with a learned auxiliary classifier. |
| Outcome: | The proposed framework generates a large number of diverse counterfactuals and labels them with a learned classifier. |
Retrieval-guided Counterfactual Generation for QA (2022.acl-long)
Copied to clipboard
| Challenge: | Recent work shows that data augmentation using counterfactuals can help ameliorate this weakness. |
| Approach: | They propose a Retrieve-Generate-Filter technique to generate counterfactuals using QA framework and question generation model trained on original task data. |
| Outcome: | The proposed method improves performance on out-of-domain and challenging evaluation sets over and above existing methods. |