Model Interpretability and Rationale Extraction by Input Mask Optimization (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for creating explanations for black-box models struggle with deriving easily interpretable explanations. |
| Approach: | They propose a model-agnostic method to generate extractive explanations for neural network predictions using masking parts of the input that the model does not consider indicative of the respective class. |
| Outcome: | The proposed method achieves state-of-the-art results in a paragraph-level rationale extraction task, showing that this task can be performed without training a specialized model. |
Similar Papers
Interpretable Neural Predictions with Differentiable Binary Variables (P19-1)
Copied to clipboard
| Challenge: | Neural networks are bringing incredible performance gains on text classification tasks, but they also require interpretability. |
| Approach: | They propose a latent model that selects a rationale and a classifier that learns from the words in the rationale alone. |
| Outcome: | The proposed model can predict expected value of penalties without REINFORCE and can be directly optimised towards a pre-specified text selection rate. |
Using Interpretation Methods for Model Enhancement (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing frameworks for enhancing neural models with interpretation methods and gold rationales have not been fully explored. |
| Approach: | They propose a framework for utilizing interpretation methods and gold rationales to enhance neural models. |
| Outcome: | The proposed framework outperforms gradient-based methods in low-resource settings on a variety of tasks. |
Improve Interpretability of Neural Networks via Sparse Contrastive Coding (2022.findings-emnlp)
Copied to clipboard
| Challenge: | XAI has achieved remarkable advances, but few efforts have been devoted to solving the problem. |
| Approach: | They propose a model-agnostic explanation method termed Sparse Contrastive Coding . they use model-based explanations to explain the black-box in a more model-oriented way . |
| Outcome: | The proposed method outperforms five state-of-the-art methods in interpretability and classification metrics. |
Towards Explainable NLP: A Generative Explanation Framework for Text Classification (P19-1)
Copied to clipboard
| Challenge: | Existing approaches for explainable machine learning systems focus on interpreting outputs or connections between inputs and outputs. |
| Approach: | They propose a generative explanation framework that learns to make classification decisions and generates fine-grained explanations at the same time. |
| Outcome: | The proposed framework surpasses all baselines on two datasets and generates concise explanations at the same time. |
Can Rationalization Improve Robustness? (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing models that generate rationales before making predictions can ignore noise or adversarially added text by simply masking it out of the generated rationale. |
| Approach: | They propose to use a 'rationalizethen-predict' framework to generate subsets of input to generate rationales and then make predictions using them. |
| Outcome: | The proposed models improve robustness over AddText attacks while struggling in certain scenarios. |
How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable Masking (2020.emnlp-main)
Copied to clipboard
| Challenge: | Attribution methods assess the contribution of inputs to the model prediction. |
| Approach: | They propose a method which removes subsets of inputs and a model which is based on hidden layers to make the decision to include or disregard an input token. |
| Outcome: | The proposed method is efficient because it predicts rather than searches the inputs. |
Interpretable Rationale Augmented Charge Prediction System (C18-2)
Copied to clipboard
| Challenge: | Existing studies treat charge prediction as a text classification problem, but in the field of justice, every decision may be a matter of life and death. |
| Approach: | They propose to extract readable rationales from text and then create a rationale augmented classification model to enhance the prediction accuracy. |
| Outcome: | The proposed system can extract readable rationales in a high consistency with manual annotation and is comparable with the attention model in prediction accuracy. |
Learning Variational Word Masks to Improve the Interpretability of Neural Text Classifiers (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for improving model interpretability require prior information or human annotations as additional inputs. |
| Approach: | They propose a variational word mask method to automatically learn task-specific important words and reduce irrelevant information on classification, which ultimately improves model interpretability. |
| Outcome: | The proposed method improves model prediction accuracy and interpretability on seven datasets. |
RANCC: Rationalizing Neural Networks via Concept Clustering (2020.coling-main)
Copied to clipboard
| Challenge: | Existing models that construct explanations concurrently with classification predictions are opaque. |
| Approach: | They propose a self-explainable model for Natural Language Processing (NLP) text classification tasks . they extract a rationale from the text and use it to predict a concept of interest . |
| Outcome: | The proposed model can be compressed without complicated compression techniques. |
Plausible Extractive Rationalization through Semi-Supervised Entailment Signal (2024.findings-acl)
Copied to clipboard
| Challenge: | Abstract: Large language models are gaining widespread adoption in natural language processing tasks. |
| Approach: | They propose a semi-supervised approach to optimize for plausibility of extracted rationales by using a pre-trained natural language inference model and a supervised NLI predictor. |
| Outcome: | The proposed model outperforms unsupervised models by > 100% on a ERASER dataset. |