Papers by Nandi Schoots
One Mask to Rule Them All: On Hidden Facts after Editing and How to Find Them (2026.findings-acl)
Copied to clipboard
| Challenge: | Knowledge editing methods such as ROME and MEMIT update factual associations by modifying MLP weights. |
| Approach: | They propose to use a mask to reverse edits by eliminating overattention in later layers . they also show that injecting the mask during editing drops editing success from 98% to 38% . |
| Outcome: | The proposed method reverses edits by eliminating overattention in later layers and drops editing success from 98% to 38%. |
Punctuations and Predicates in Language Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Recent work has shown that LLMs perform tasks in ways that diverge significantly from human reasoning. |
| Approach: | They examine the computational importance of punctuation tokens in large language models . they use zeroing and layer-swapping techniques to examine their necessity and sufficiency . |
| Outcome: | The proposed model differs in GPT-2, DeepSeek, and Gemma in that punctuation is necessary and sufficient in multiple layers . the findings offer new insight into the internal mechanisms of punctuations in LLMs and have implications for interpretability and model analysis. |