Papers by Ludwig Sickert
Inseq: An Interpretability Toolkit for Sequence Generation Models (2023.acl-demo)
Copied to clipboard
| Challenge: | Recent studies focused on classification tasks while largely overlooking generation settings due to a lack of dedicated tools. |
| Approach: | They propose to use Inseq to democratize access to interpretability analyses of sequence generation models by enabling intuitive extraction of models’ internal information and feature importance scores for popular decoder-only and encoder-decoder Transformers architectures. |
| Outcome: | The proposed library can extract models’ internal information and feature importance scores for popular decoder-only and encoder-decoder Transformers architectures. |