Comparing Automatic and Human Evaluation of Local Explanations for Text Classification (N18-1)
Copied to clipboard
| Challenge: | Text classification models are becoming increasingly complex and opaque, however for many applications it is essential that the models are interpretable. |
| Approach: | They propose to use automatic word deletion to generate local explanations for a text classification model by crowdsourcing the evaluation using a crowdsourced experiment. |
| Outcome: | The proposed evaluations of local explanations using crowdsourcing and automatic measures correlate with the results. |
Similar Papers
Human-Centered Evaluation of Explanations (2022.naacl-tutorials)
Copied to clipboard
Jordan Boyd-Graber, Samuel Carton, Shi Feng, Q. Vera Liao, Tania Lombrozo, Alison Smith-Renner, Chenhao Tan
| Challenge: | This tutorial will provide an overview of human-centered evaluations of explanations . |
| Approach: | This tutorial will provide an overview of human-centered evaluations of explanations . it will introduce the psychological foundation of explanation and types of NLP explanations. |
| Outcome: | This tutorial will provide an overview of human-centered evaluations of explanations . it will cover the two categories of evaluation: evaluation based on human-annotated explanations and evaluation with human-subjects studies. |
A Diagnostic Study of Explainability Techniques for Text Classification (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing explainability techniques that can be produced post-hoc with already trained models are lacking a definitive guide on how to choose one given a particular task and model architecture. |
| Approach: | They propose to use a list of diagnostic properties to evaluate existing explainability techniques to compare them with human annotations of salient input regions. |
| Outcome: | The proposed list compares a set of explainability techniques on downstream text classification tasks and neural network architectures. |
Human-grounded Evaluations of Explanation Methods for Text Classification (D19-1)
Copied to clipboard
| Challenge: | Explainable Artificial Intelligence (XAI) is aimed at providing explanations for decisions made by AI systems. |
| Approach: | They propose to use model-agnostic and model-specific explanation methods for CNNs for text classification to provide human-grounded evaluations. |
| Outcome: | The proposed methods could be used to explain models' results and improve AIs and humans in many cases. |
Evaluating Saliency Explanations in NLP by Crowdsourcing (2024.lrec-main)
Copied to clipboard
| Challenge: | a crowdsourced method to evaluate saliency methods in NLP is proposed . saliencies are difficult for humans to understand, and can cause psychological harm . |
| Approach: | They propose a method to evaluate saliency methods in NLP by crowdsourcing . they recruited 800 crowd workers and empirically evaluated seven salience methods . |
| Outcome: | The proposed method evaluates saliency methods on two datasets using crowdsourced data . it shows that the results are comparable to existing methods on NLP and CV fields . |
A Study of Automatic Metrics for the Evaluation of Natural Language Explanations (2021.eacl-main)
Copied to clipboard
| Challenge: | a lack of transparency is a key issue for robotics and AI. |
| Approach: | They propose to map existing automatic evaluation methods for natural language generation onto explanations. |
| Outcome: | The proposed model shows that embedding-based evaluation methods have higher correlations with human ratings than word-overlap metrics. |
SHAP-Based Explanation Methods: A Review for NLP Interpretability (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models with opacity problems have been proposed to address this problem. |
| Approach: | They propose a unified local-interpretability framework with a rigorous theoretical foundation on the game-theoretic concept of Shapley values. |
| Outcome: | The proposed framework is based on the Shapley-value-based model explanations. |
On Evaluating Explanation Utility for Human-AI Decision Making in NLP (2024.findings-emnlp)
Copied to clipboard
| Challenge: | a lack of evidence that explanations help people in situations they are introduced for is a problem in NLP . prior work on explainability has focused on overcoming technical challenges and used proxy evaluations. |
| Approach: | They propose to use existing metrics to evaluate the effectiveness of explanations in NLP . they argue that providing AI predictions does not cause decision makers to speed up work . |
| Outcome: | The proposed evaluations show that providing AI predictions does not cause decision makers to speed up their work without compromising performance. |
A Survey of the State of Explainable AI for Natural Language Processing (2020.aacl-main)
Copied to clipboard
| Challenge: | Recent years have seen significant advances in the quality of state-of-the-art models, but they have come at the expense of models becoming less interpretable. |
| Approach: | This survey examines the current state of Explainable AI within the domain of NLP . they detail the operations and explainability techniques currently available for generating explanations for NLP models . |
| Outcome: | This survey examines the state of explainable AI (XAI) within the domain of natural language processing . it focuses on the operations and explainability techniques currently available for NLP models . |
On Sample Based Explanation Methods for NLP: Faithfulness, Efficiency and Semantic Evaluation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for explaining "black-box" models such as Influence Functions are becoming more popular. |
| Approach: | They propose a semantic-based evaluation metric that can better align with humans’ judgment of explanations than the widely adopted diagnostic or re-training measures. |
| Outcome: | The proposed method can better align with humans’ judgment of explanations than diagnostic or re-training measures. |
Reframing Human-AI Collaboration for Generating Free-Text Explanations (2022.naacl-main)
Copied to clipboard
| Challenge: | Large language models are capable of generating fluent-appearing text with little task-specific supervision. |
| Approach: | They propose a pipeline that combines GPT-3 with a supervised filter that incorporates binary acceptability judgments from humans in the loop. |
| Outcome: | The proposed model can generate freetext explanations in a fewshot setting with human-written examples. |