Papers by Amit Elhelo
Inferring Functionality of Attention Heads from their Parameters (2025.acl-long)
Copied to clipboard
| Challenge: | Prior work on attention heads focused on analyzing their behavior during inference for specific circuits or tasks. |
| Approach: | They propose a framework that maps the functions of attention heads without any model training or inference. |
| Outcome: | The proposed framework infers the functionality of attention heads without any model training or inference. |