Papers by Thomas Fel
COCKATIEL: COntinuous Concept ranKed ATtribution with Interpretable ELements for explaining neural net classifiers on NLP (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent debates have shown that attention maps and attribution methods are unreliable. |
| Approach: | They propose a model-agnostic XAI technique that generates meaningful explanations from the last layer of a neural net model trained on an NLP classification task by using Non-Negative Matrix Factorization to discover concepts the model leverages to make predictions. |
| Outcome: | The proposed technique generates meaningful explanations from the last layer of a neural net model trained on an NLP classification task without compromising the accuracy of the underlying model or requiring a new one to be trained. |