Papers by Andrej Erkelens
Using Shapley interactions to understand how models use structure (2025.acl-long)
Copied to clipboard
| Challenge: | Language models are intricately structured systems, and attribution measures are important for understanding how they combine features to influence outputs. |
| Approach: | They use Shapley Taylor interaction indices to examine how language and speech models internally relate and structure their inputs. |
| Outcome: | The proposed methods show that language models encode phonetic interactions . they show that the inputs are more entangled for pairs where a consonant influences a vowel or approximant . |