What Gets Echoed? Understanding the “Pointers” in Explanations of Persuasive Arguments (D19-1)
Copied to clipboard
| Challenge: | Explanations are central to everyday life, and are a topic of growing interest in the AI community. |
| Approach: | They propose a word-level prediction task to investigate how explanations selectively reuse information from what is being explained. |
| Outcome: | The proposed features have strong predictive power on the echoing of a word in an explanation, and enhance neural methods of generating explanations. |
Similar Papers
AutoPersuade: A Framework for Evaluating and Explaining Persuasive Arguments (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing tools for persuasion are well-equipped to identify which of a pre-existing set of messages is most persuasive, but they do not offer causal evidence on whether or how they have succeeded. |
| Approach: | They propose a framework for identifying topical components of persuasive arguments that are autopersuade. |
| Outcome: | The proposed framework validates the results through human studies and out-of-sample predictions. |
A Survey of the State of Explainable AI for Natural Language Processing (2020.aacl-main)
Copied to clipboard
| Challenge: | Recent years have seen significant advances in the quality of state-of-the-art models, but they have come at the expense of models becoming less interpretable. |
| Approach: | This survey examines the current state of Explainable AI within the domain of NLP . they detail the operations and explainability techniques currently available for generating explanations for NLP models . |
| Outcome: | This survey examines the state of explainable AI (XAI) within the domain of natural language processing . it focuses on the operations and explainability techniques currently available for NLP models . |
On the Diversity and Limits of Human Explanations (2022.naacl-main)
Copied to clipboard
| Challenge: | a growing effort in NLP aims to build datasets of human explanations, but it remains unclear whether they serve their intended goals. |
| Approach: | They argue that the term "explanation" is overloaded and refers to a broad range of notions with different properties and ramifications. |
| Outcome: | The proposed datasets examine the diversity of explanations and their use in NLP. |
SHAP-Based Explanation Methods: A Review for NLP Interpretability (2022.coling-1)
Copied to clipboard
| Challenge: | Existing models with opacity problems have been proposed to address this problem. |
| Approach: | They propose a unified local-interpretability framework with a rigorous theoretical foundation on the game-theoretic concept of Shapley values. |
| Outcome: | The proposed framework is based on the Shapley-value-based model explanations. |
Explaining Language Model Predictions with High-Impact Concepts (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to explain large language models (LLMs) are mostly correlational and lack causal features due to compositional nature of languages. |
| Approach: | They propose a framework to provide impact-aware explanations for large language models that are robust to feature changes and influential to the model’s predictions. |
| Outcome: | The proposed explanations improve on real and synthetic tasks and are robust to feature changes and influential to the model’s predictions. |
Evaluating Explainable AI: Which Algorithmic Explanations Help Users Predict Model Behavior? (2020.acl-main)
Copied to clipboard
| Challenge: | a new study examines the impact of algorithmic explanations on simulatability of machine learning models . a model is simulatable when a person can predict its behavior on new inputs . |
| Approach: | They conduct human subject tests to isolate effect of algorithmic explanations on simulatability . they find ratings of explanations are not predictive of how helpful they are . |
| Outcome: | The results provide the first reliable estimates of how explanations influence simulatability . they show that ratings are not predictive of how helpful explanations are . |
Prompting Contrastive Explanations for Commonsense Reasoning Tasks (2021.findings-acl)
Copied to clipboard
| Challenge: | Large pretrained language models (PLMs) can achieve near-human performance on commonsense reasoning tasks, but provide little human-interpretable evidence of the underlying reasoning they use. |
| Approach: | They propose to use large pretrained language models to generate evidence for commonsense reasoning NLP tasks . they use models to contrast alternative explanations based on key attribute(s) required to justify the correct answer . |
| Outcome: | The proposed model improves performance on two commonsense reasoning benchmarks compared to previous non-contrastive alternatives. |
Why Attention is Not Explanation: Surgical Intervention and Causal Reasoning about Neural Models (2020.lrec-1)
Copied to clipboard
| Challenge: | a recent study finds brittleness in explanations obtained through attention mechanisms . a philosophy of science theory allows robust yet non-causal reasoning in explanation . |
| Approach: | They propose to use philosophy of science to examine the state-of-the-art in explanation for NLP models . they argue that it is impossible to explain attention-based learning by attention mechanisms . |
| Outcome: | The proposed model selection criteria are based on philosophy of science theories . the proposed model is based upon a model that is more explainable than a classical model . |
Let’s do it “again”: A First Computational Approach to Detecting Adverbial Presupposition Triggers (P18-1)
Copied to clipboard
| Challenge: | a novel task of predicting adverbial presupposition triggers is useful for natural language generation . a focus is on a new attention mechanism for predicting presuposition trigger . |
| Approach: | They propose a new attention mechanism for predicting adverbial presupposition triggers . they propose to augment a baseline neural network without additional trainable parameters . |
| Outcome: | The proposed model outperforms baseline models in predicting adverbial presupposition triggers. |
Trigger-Argument based Explanation for Event Detection (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing works on ED use words or phrases to explain models’ inner mechanisms, but for ED, the event structure is more enlightening clues to explain model behaviors. |
| Approach: | They propose a Trigger-Argument based Explanation method which can utilize event structure knowledge to uncover a faithful interpretation for existing ED models at neuron level. |
| Outcome: | The proposed method can reveal the process by which the model predicts on the large-scale MAVEN and the widely-used ACE 2005 datasets. |