Dynamic Top-k Estimation Consolidates Disagreement between Feature Attribution Methods (2023.emnlp-main)
Copied to clipboard
| Challenge: | Feature attribution scores are used to explain the prediction of a text classifier to users by highlighting a k number of tokens. |
| Approach: | They propose to determine the number of optimal k tokens that should be displayed from sequential properties of attribution scores. |
| Outcome: | The proposed method is dynamic across sentences, method-agnostic, and deals with sentence length bias. |
Similar Papers
Incorporating Priors with Feature Attribution on Text Classification (P19-1)
Copied to clipboard
| Challenge: | Feature attribution methods are used to help users interpret complex models. |
| Approach: | They propose a feature attribution method that integrates feature attributed features into the objective function to allow machine learning practitioners to incorporate priors in model building. |
| Outcome: | The proposed method reduces undesired model biases without a tradeoff on the original task and improves classifier performance in scarce data setting. |
Necessity and Sufficiency for Explaining Text Classifiers: A Case Study in Hate Speech Detection (2022.naacl-main)
Copied to clipboard
| Challenge: | XAI features usually provide a single importance score for each token, but feature attribution methods provide two complementary and theoretically-grounded scores for each utterance. |
| Approach: | They propose a feature attribution method that generates explicit perturbations of the input text, allowing the importance scores themselves to be explainable. |
| Outcome: | The proposed method explain the predictions of hate speech detection models on a set of curated examples from a test suite. |
An Attribution Method for Siamese Encoders (2023.emnlp-main)
Copied to clipboard
| Challenge: | Despite the success of Siamese encoder models, little is known about the aspects of inputs they base their decisions on. |
| Approach: | They propose a local attribution method for Siamese encoders by generalizing the principle of integrated gradients to models with multiple inputs. |
| Outcome: | The proposed method can be reduced to a token–token matrix and account for the model’s full computation graph and is guaranteed to converge to the actual prediction. |
Explaining Pre-Trained Language Models with Attribution Scores: An Analysis in Low-Resource Settings (2024.lrec-main)
Copied to clipboard
| Challenge: | Currently, prompt-based models are gaining popularity due to their easier adaptability in low-resource settings. |
| Approach: | They analyze attribution scores extracted from prompt-based models w.r.t. plausibility and faithfulness and compare them with attribution score extracted from fine-tuned models and large language models. |
| Outcome: | The proposed model outperforms attention and Integrated Gradients in plausibility and faithfulness, while fine-tuning models are harder to explain in low-resource settings. |
Dynamic Multi-granularity Attribution Network for Aspect-based Sentiment Analysis (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for predicting sentiment polarity of aspects are susceptible to interference caused by irrelevant contexts and lack sentiment knowledge at a data-specific level. |
| Approach: | They propose a novel Aspect-based sentiment analysis method that leverages attention scores to model the relationships between aspects and contexts. |
| Outcome: | The proposed method is able to predict sentiments from a set of five benchmark datasets. |
PR-XAI: PageRank-Based Feature Attribution for Transformers (2026.acl-long)
Copied to clipboard
| Challenge: | Existing feature attribution methods for transformer models suffer from limitations that undermine their efficacy. |
| Approach: | They propose a feature attribution method for transformer models based on PageRank . they propose attribution methods that apply PageRank to attention-derived graphs . |
| Outcome: | The proposed method outperforms state-of-the-art methods in faithfulness and classification metrics with significant gains on long-form text. |
Logic Traps in Evaluating Attribution Scores (2022.acl-long)
Copied to clipboard
| Challenge: | Modern deep learning models are notoriously opaque, which has motivated the development of methods for interpreting how deep models predict. |
| Approach: | They propose to review existing methods for evaluating attribution scores and summarize the logic traps in these methods. |
| Outcome: | The proposed methods show that they do not contain logic traps and that they are not reliable. |
Integrated Directional Gradients: Feature Interaction Attribution for Neural NLP Models (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for attribution of importance to features borrowed from cooperative game theory . success of Deep Neural Networks has led to their ability to learn from complex higher order interactions from raw features. |
| Approach: | They propose a method for attributing importance scores to groups of features . they propose axioms that any intuitive feature group attribution method should satisfy . |
| Outcome: | The proposed method captures the importance of features in a linguistic model using negations and conjunctions. |
On the Interaction of Belief Bias and Explanations (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to evaluate explainability fail to account for belief biases affecting human performance . previous studies have shown that neural models can make confident predictions relying on artifacts . |
| Approach: | They propose to account for belief bias in explainability by using models of varying quality and adversarial examples. |
| Outcome: | The proposed methods show that results change when using models of varying quality and adversarial examples. |
TokenShapley: Token Level Context Attribution with Shapley Value (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have strong capabilities in in-context learning, but verifying the correctness of their generated responses remains a challenge. |
| Approach: | They propose a token-level attribution method that combines Shapley value-based data attribution with KNN-based retrieval techniques to improve attribution accuracy. |
| Outcome: | TokenShapley outperforms state-of-the-art methods on four benchmarks . it achieves an 11–23% improvement in accuracy on the benchmarks. |