Challenge: Existing methods to augment training data with counterfactuals fail to handle multi-hop fact verification due to their incapability to preserve complex logical relationships.
Approach: They propose to augment training data with counterfactuals that alter causal features of the original data by preserving logical relationships.
Outcome: The proposed method outperforms the baselines and can generate linguistically diverse counterfactuals without disrupting their logical relationships.

Similar Papers

NeuroCounterfactuals: Beyond Minimal-Edit Counterfactuals for Richer Data Augmentation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to produce counterfactuals rely on small perturbations via minimal edits, resulting in simplistic changes.
Approach: They propose a novel approach to produce counterfactuals that allow for larger edits and linguistic diversity while still bearing similarity to the original document.
Outcome: The proposed approach outperforms existing methods for generalizing natural language models under select settings.
CREST: A Joint Framework for Rationalization and Counterfactual Text Generation (2023.acl-long)

Copied to clipboard

Challenge: Existing methods for analyzing and training NLP models have not been integrated to combine their complementary advantages.
Approach: They introduce a framework for selective rationalization and counterfactual text generation that leverages CREST to regularize selective rationales and a loss function that regularizes selective rationals.
Outcome: The proposed framework generates valid counterfactuals that are more natural than those produced by previous methods and can be used for data augmentation at scale.
Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysis (2021.acl-long)

Copied to clipboard

Challenge: Existing approaches to improve performance of deep neural models are limited by the nature of spurious patterns in the data.
Approach: They propose to use augmented data to generate spurious patterns in NLP models . they propose to generate counterfactual data for data augmentation and explanation .
Outcome: The proposed approach improves performance on augmented data and on human-generated data.
Dually Self-Improved Counterfactual Data Augmentation Using Large Language Model (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to generate counterfactual data augmentation are limited due to imbalance and biases in real-world training data.
Approach: They propose a self-improved method for generating high-quality counterfacts using large language models.
Outcome: The proposed method generates high-quality counterfacts on the natural language inference task using lightweight and task-specific LLMs.
Denoising Rationalization for Multi-hop Fact Verification via Multi-granular Explainer (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing rationalization methods for multi-hop fact verification lack nuanced composition in the evidence, which leads to noise rationalization.
Approach: They propose a method to obtain rationale by completely removing subset of input without compromising verification accuracy.
Outcome: The proposed method outperforms 12 baselines on three multi-hop fact verification datasets.
EX-FEVER: A Dataset for Multi-hop Explainable Fact Verification (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies on fact verification lack a high-quality dataset for explainability . existing systems lack evidence retrieval and veracity prediction, limiting the ability to verify a claim .
Approach: They propose a dataset for multi-hop explainable fact verification that summarises and modifies Wikipedia documents.
Outcome: The proposed dataset aims to improve the accuracy of multi-hop explainable fact verification systems.
Counterfactuals of Counterfactuals: a back-translation-inspired approach to analyse counterfactual editors (2023.findings-acl)

Copied to clipboard

Challenge: Existing explanations for classifiers are counterfactual or contrastive . lack of universal ground truth for counterf actual edits hinders their evaluation .
Approach: They propose a back translation-inspired evaluation methodology that utilises earlier outputs of the explainer as ground truth proxies to investigate the consistency of explainers.
Outcome: The proposed method can provide valuable insights into the behaviour of predictor and explainer models and infer patterns that would otherwise be obscured.
CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generation (2022.findings-emnlp)

Copied to clipboard

Challenge: Prior work on counterfactual data augmentation only considered restricted classes of perturbations, limiting their effectiveness.
Approach: They propose a retrieval-augmented framework for creating diverse counterfactual perturbations for CDA.
Outcome: Experiments on natural language inference and sentiment analysis show that the proposed framework can be used to encourage diversity in manually authored perturbations.
Consistent Document-level Relation Extraction via Counterfactuals (2024.findings-emnlp)

Copied to clipboard

Challenge: Document-level relation extraction models trained on factual data exhibit inconsistent behavior, relying on spurious signals such as specific entities and external knowledge to extract triples.
Approach: They propose a counterfactual data generation approach for document-level relation extraction datasets using entity replacement to generate triples from factual data.
Outcome: The proposed approach extracts triples from factual data but fails on counterfactual modification.
People Make Better Edits: Measuring the Efficacy of LLM-Generated Counterfactually Augmented Data for Harmful Language Detection (2023.emnlp-main)

Copied to clipboard

Challenge: Past work has shown that counterfactually augmented data (CADs) can improve models' performance on out-of-domain tests.
Approach: They use Polyjuice, ChatGPT, and Flan-T5 to automatically generate CADs . they find that CAD generates a model that flips the original label with minimal changes .
Outcome: The proposed model improves model robustness on out-of-domain test sets and individual data points.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations