EXPLAIN, EDIT, GENERATE: Rationale-Sensitive Counterfactual Data Augmentation for Multi-hop Fact Verification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to augment training data with counterfactuals fail to handle multi-hop fact verification due to their incapability to preserve complex logical relationships. |
| Approach: | They propose to augment training data with counterfactuals that alter causal features of the original data by preserving logical relationships. |
| Outcome: | The proposed method outperforms the baselines and can generate linguistically diverse counterfactuals without disrupting their logical relationships. |
Similar Papers
NeuroCounterfactuals: Beyond Minimal-Edit Counterfactuals for Richer Data Augmentation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to produce counterfactuals rely on small perturbations via minimal edits, resulting in simplistic changes. |
| Approach: | They propose a novel approach to produce counterfactuals that allow for larger edits and linguistic diversity while still bearing similarity to the original document. |
| Outcome: | The proposed approach outperforms existing methods for generalizing natural language models under select settings. |
CREST: A Joint Framework for Rationalization and Counterfactual Text Generation (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for analyzing and training NLP models have not been integrated to combine their complementary advantages. |
| Approach: | They introduce a framework for selective rationalization and counterfactual text generation that leverages CREST to regularize selective rationales and a loss function that regularizes selective rationals. |
| Outcome: | The proposed framework generates valid counterfactuals that are more natural than those produced by previous methods and can be used for data augmentation at scale. |
Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysis (2021.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to improve performance of deep neural models are limited by the nature of spurious patterns in the data. |
| Approach: | They propose to use augmented data to generate spurious patterns in NLP models . they propose to generate counterfactual data for data augmentation and explanation . |
| Outcome: | The proposed approach improves performance on augmented data and on human-generated data. |
Dually Self-Improved Counterfactual Data Augmentation Using Large Language Model (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to generate counterfactual data augmentation are limited due to imbalance and biases in real-world training data. |
| Approach: | They propose a self-improved method for generating high-quality counterfacts using large language models. |
| Outcome: | The proposed method generates high-quality counterfacts on the natural language inference task using lightweight and task-specific LLMs. |
Denoising Rationalization for Multi-hop Fact Verification via Multi-granular Explainer (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing rationalization methods for multi-hop fact verification lack nuanced composition in the evidence, which leads to noise rationalization. |
| Approach: | They propose a method to obtain rationale by completely removing subset of input without compromising verification accuracy. |
| Outcome: | The proposed method outperforms 12 baselines on three multi-hop fact verification datasets. |
EX-FEVER: A Dataset for Multi-hop Explainable Fact Verification (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies on fact verification lack a high-quality dataset for explainability . existing systems lack evidence retrieval and veracity prediction, limiting the ability to verify a claim . |
| Approach: | They propose a dataset for multi-hop explainable fact verification that summarises and modifies Wikipedia documents. |
| Outcome: | The proposed dataset aims to improve the accuracy of multi-hop explainable fact verification systems. |
Counterfactuals of Counterfactuals: a back-translation-inspired approach to analyse counterfactual editors (2023.findings-acl)
Copied to clipboard
George Filandrianos, Edmund Dervakos, Orfeas Menis Mastromichalakis, Chrysoula Zerva, Giorgos Stamou
| Challenge: | Existing explanations for classifiers are counterfactual or contrastive . lack of universal ground truth for counterf actual edits hinders their evaluation . |
| Approach: | They propose a back translation-inspired evaluation methodology that utilises earlier outputs of the explainer as ground truth proxies to investigate the consistency of explainers. |
| Outcome: | The proposed method can provide valuable insights into the behaviour of predictor and explainer models and infer patterns that would otherwise be obscured. |
CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work on counterfactual data augmentation only considered restricted classes of perturbations, limiting their effectiveness. |
| Approach: | They propose a retrieval-augmented framework for creating diverse counterfactual perturbations for CDA. |
| Outcome: | Experiments on natural language inference and sentiment analysis show that the proposed framework can be used to encourage diversity in manually authored perturbations. |
Consistent Document-level Relation Extraction via Counterfactuals (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Document-level relation extraction models trained on factual data exhibit inconsistent behavior, relying on spurious signals such as specific entities and external knowledge to extract triples. |
| Approach: | They propose a counterfactual data generation approach for document-level relation extraction datasets using entity replacement to generate triples from factual data. |
| Outcome: | The proposed approach extracts triples from factual data but fails on counterfactual modification. |
People Make Better Edits: Measuring the Efficacy of LLM-Generated Counterfactually Augmented Data for Harmful Language Detection (2023.emnlp-main)
Copied to clipboard
| Challenge: | Past work has shown that counterfactually augmented data (CADs) can improve models' performance on out-of-domain tests. |
| Approach: | They use Polyjuice, ChatGPT, and Flan-T5 to automatically generate CADs . they find that CAD generates a model that flips the original label with minimal changes . |
| Outcome: | The proposed model improves model robustness on out-of-domain test sets and individual data points. |