Papers by Masaki Sashida
Revealing Redundant Syntax in Large Language Models through Multi-Hop Dependency Paths (2026.findings-eacl)
Copied to clipboard
| Challenge: | Prior work on attention–syntax alignment has focused on single-hop Universal Dependency edges (DPs). |
| Approach: | They extract 2–3 hop MDPs from UD-parsed English and quantify head–relation alignment with an Unlabeled Attachment Score (UAS)-style metric modified for causal masking in decoder-only models. |
| Outcome: | The authors show that head alignments are overlapped and specialized . the head alignment is measurable in large language models trained on raw text . |