Challenge: a number of post hoc explanation methods for deep neural networks have been proposed . due to the complexity of the DNNs they explain, these methods are necessarily approximations and come with their own sources of error.
Approach: They propose two evaluation paradigms that cover two important classes of NLP problems . they propose LIMSSE, LRP and DeepLIFT as the most effective explanation methods .
Outcome: The proposed methods are most effective for explaining deep neural networks in NLP . the proposed methods can explain complex models without manual annotation .

Similar Papers

SHAP-Based Explanation Methods: A Review for NLP Interpretability (2022.coling-1)

Copied to clipboard

Challenge: Existing models with opacity problems have been proposed to address this problem.
Approach: They propose a unified local-interpretability framework with a rigorous theoretical foundation on the game-theoretic concept of Shapley values.
Outcome: The proposed framework is based on the Shapley-value-based model explanations.
Neuron-level Interpretation of Deep NLP Models: A Survey (2022.tacl-1)

Copied to clipboard

Challenge: Existing work on deep neural networks has focused on representation analysis, but recent work focused on analyzing neurons within these models.
Approach: They propose to analyze neural networks to uncover linguistic concepts captured by the network . they propose to use a granular approach to analyze neurons within these models .
Outcome: The proposed method combines methods to discover and understand neurons in a network with evaluation methods.
Interpretability and Analysis in Neural NLP (2020.acl-tutorials)

Copied to clipboard

Challenge: a tutorial aims to introduce the nascent field of interpretability and analysis of neural networks in NLP .
Approach: This tutorial will introduce the nascent field of interpretability and analysis of neural networks in NLP.
Outcome: This tutorial will introduce the nascent field of interpretability and analysis of neural networks in NLP.
Human-grounded Evaluations of Explanation Methods for Text Classification (D19-1)

Copied to clipboard

Challenge: Explainable Artificial Intelligence (XAI) is aimed at providing explanations for decisions made by AI systems.
Approach: They propose to use model-agnostic and model-specific explanation methods for CNNs for text classification to provide human-grounded evaluations.
Outcome: The proposed methods could be used to explain models' results and improve AIs and humans in many cases.
Human-Centered Evaluation of Explanations (2022.naacl-tutorials)

Copied to clipboard

Challenge: This tutorial will provide an overview of human-centered evaluations of explanations .
Approach: This tutorial will provide an overview of human-centered evaluations of explanations . it will introduce the psychological foundation of explanation and types of NLP explanations.
Outcome: This tutorial will provide an overview of human-centered evaluations of explanations . it will cover the two categories of evaluation: evaluation based on human-annotated explanations and evaluation with human-subjects studies.
Fine-grained Interpretation and Causation Analysis in Deep NLP Models (2021.naacl-tutorials)

Copied to clipboard

Challenge: Despite the proven efficacy of deep neural networks at-large, their opaqueness is a major cause of concern.
Approach: They will present research work on interpreting fine-grained components of a neural network model from two perspectives, i) fine-grain interpretation, and ii) causation analysis.
Outcome: This paper presents work on interpreting fine-grained components of a neural network model from two perspectives, i) fine-grain interpretation, and ii) causation analysis.
Interpreting Predictions of NLP Models (2020.emnlp-tutorials)

Copied to clipboard

Challenge: This tutorial will provide a background on interpretation techniques for neural NLP models.
Approach: This tutorial will provide a background on interpretation techniques for NLP models . it will examine saliency maps, input perturbations, adversarial attacks and influence functions .
Outcome: This tutorial will provide a background on interpretation techniques . examples-specific interpretations include saliency maps, input perturbations, adversarial attacks, influence functions .
On Sample Based Explanation Methods for NLP: Faithfulness, Efficiency and Semantic Evaluation (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for explaining "black-box" models such as Influence Functions are becoming more popular.
Approach: They propose a semantic-based evaluation metric that can better align with humans’ judgment of explanations than the widely adopted diagnostic or re-training measures.
Outcome: The proposed method can better align with humans’ judgment of explanations than diagnostic or re-training measures.
From Nodes to Narratives: Explaining Graph Neural Networks with LLMs and Graph Context (2026.acl-long)

Copied to clipboard

Challenge: Existing explanation methods for graph neural networks struggle to generate interpretable, fine-grained rationales.
Approach: They propose a lightweight framework that uses large language models to generate interpretable explanations for GNNs.
Outcome: The proposed framework generates interpretable explanations for GNN predictions using large language models.
On Evaluating Explanation Utility for Human-AI Decision Making in NLP (2024.findings-emnlp)

Copied to clipboard

Challenge: a lack of evidence that explanations help people in situations they are introduced for is a problem in NLP . prior work on explainability has focused on overcoming technical challenges and used proxy evaluations.
Approach: They propose to use existing metrics to evaluate the effectiveness of explanations in NLP . they argue that providing AI predictions does not cause decision makers to speed up work .
Outcome: The proposed evaluations show that providing AI predictions does not cause decision makers to speed up their work without compromising performance.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations