Generating Plausible Counterfactual Explanations for Deep Transformers in Financial Text Classification (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for generating textual-based explanations are highly implausible and damage a user’s trust in the automated system. |
| Approach: | They propose a method which first applies robust transformer models on a real-world, up-to-date, self-collected mergers and acquisitions dataset and then generates plausible, post-hoc, counterfactual explanations. |
| Outcome: | The proposed model improves model accuracy and human performance while generating plausible explanations based on human trials. |
Similar Papers
XAI-Attack: Utilizing Explainable AI to Find Incorrectly Learned Patterns for Black-Box Adversarial Example Creation (2024.lrec-main)
Copied to clipboard
| Challenge: | Adversarial examples can be used to trick machine learning models into making erroneous predictions, causing poorer insights and lower confidence in the information gathered. |
| Approach: | They propose a textual adversarial example method that identifies falsely learned word indicators by leveraging explainable AI methods as importance functions on incorrectly predicted instances. |
| Outcome: | The proposed method outperforms existing examples and training methods and shows baseline improvements of up to 23 percentage points on adversarial tasks. |
What if This Modified That? Syntactic Interventions with Counterfactual Embeddings (2021.findings-acl)
Copied to clipboard
| Challenge: | Prior art aims to uncover meaningful properties within model representations, but it is unclear how faithfully such probes portray information that the models actually use. |
| Approach: | They propose a technique for generating counterfactual embeddings within models . they produce evidence that some models use a tree-distancelike representation of syntax . |
| Outcome: | The proposed technique produces evidence that some models use tree-distancelike representations of syntax in downstream prediction tasks. |
Towards Explainable NLP: A Generative Explanation Framework for Text Classification (P19-1)
Copied to clipboard
| Challenge: | Existing approaches for explainable machine learning systems focus on interpreting outputs or connections between inputs and outputs. |
| Approach: | They propose a generative explanation framework that learns to make classification decisions and generates fine-grained explanations at the same time. |
| Outcome: | The proposed framework surpasses all baselines on two datasets and generates concise explanations at the same time. |
Beyond Model Interpretability: On the Faithfulness and Adversarial Robustness of Contrastive Textual Explanations (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing explanations address the contrastive aspect of explanations but their extension to textual data is under-explored and there is little investigation on their vulnerabilities and limitations. |
| Approach: | They propose a novel evaluation scheme inspired by the faithfulness of explanations by extending the computation of three metrics to textual data and benchmarking POLYJUICE and MiCE on suggested metrics. |
| Outcome: | The proposed methods demonstrate that the connectedness of counterfactuals to their original counterparts is not obvious in both models. |
Deriving Strategic Market Insights with Large Language Models: A Benchmark for Forward Counterfactual Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for forward counterfactual generation face limitations . large language models (LLMs) offer promise but remain unexplored for this application . |
| Approach: | They propose a benchmark to support forward counterfactual generation in finance . they use financial news headlines to curate financial news and provide structured evaluation . |
| Outcome: | The proposed benchmark aims to provide scalable, automated insights into potential market opportunities and risks for stakeholders. |
Can LLMs Explain Themselves Counterfactually? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Explanations are an important tool for gaining insights into model behavior, calibrating user trust, and ensuring compliance. |
| Approach: | They propose to use self-explanation to prompt models to explain outputs . they find that LLMs struggle to generate SCEs - their prediction often does not agree with their own counterfactual reasoning. |
| Outcome: | The proposed methods can generate SCEs across families, sizes, temperatures, and datasets. |
DARE: Towards Robust Text Explanations in Biomedical and Healthcare Applications (2023.acl-long)
Copied to clipboard
| Challenge: | Several explainability methods have been shown to be brittle in the face of adversarial perturbations of their inputs in the image and generic textual domains. |
| Approach: | They propose to adapt existing attribution robustness estimation methods to take into account domain-specific plausibility and to train networks that display robust attributions. |
| Outcome: | The proposed methods are able to characterize domain-specific plausibility and provide robust explanations on biomedical datasets. |
Counterfactuals of Counterfactuals: a back-translation-inspired approach to analyse counterfactual editors (2023.findings-acl)
Copied to clipboard
George Filandrianos, Edmund Dervakos, Orfeas Menis Mastromichalakis, Chrysoula Zerva, Giorgos Stamou
| Challenge: | Existing explanations for classifiers are counterfactual or contrastive . lack of universal ground truth for counterf actual edits hinders their evaluation . |
| Approach: | They propose a back translation-inspired evaluation methodology that utilises earlier outputs of the explainer as ground truth proxies to investigate the consistency of explainers. |
| Outcome: | The proposed method can provide valuable insights into the behaviour of predictor and explainer models and infer patterns that would otherwise be obscured. |
Faithful Serum: Mitigating the Faithfulness Gap in Textual Explanations of LLM Decisions via Attribution Guidance (2026.acl-long)
Copied to clipboard
| Challenge: | Prior work has focused on generating convincing rationales that appear to be subjectively faithful, but it remains unclear whether these explanations are epistemic faithful. |
| Approach: | They propose a method that enhances epistemic faithfulness by guiding explanation generation through attention-level interventions, informed by token-level heatmaps. |
| Outcome: | The proposed method significantly improves epistemic faithfulness across multiple models, benchmarks, and prompts. |
Exploring the Trade-off Between Model Performance and Explanation Plausibility of Text Classifiers Using Human Rationales (2024.findings-naacl)
Copied to clipboard
| Challenge: | Saliency post-hoc explainability methods are important tools for understanding complex NLP models, but they may not align with human intuition, making the explanations not plausible. |
| Approach: | They propose a method for incorporating rationales into text classification models by augmenting the standard cross-entropy loss with a novel loss function inspired by contrastive learning. |
| Outcome: | The proposed approach enhances the plausibility of post-hoc explanations while preserving their faithfulness. |