Papers by Sadegh Mohammadian
Mechanistic Interpretability of Large-Scale Counting in LLMs through a System-2 Strategy (2026.findings-acl)
Copied to clipboard
Hosein Hasani, Mohammadali Banayeeanzade, Ali Nafisi, Sadegh Mohammadian, Fatemeh Askari, Mobin Bagherian, Amirmohammad Izadi, Mahdieh Soleymani Baghshah
| Challenge: | Large language models exhibit systematic limitations in counting tasks due to depth constraints. |
| Approach: | They propose a method that decomposes large counting tasks into smaller, independent sub-problems that the model can reliably solve. |
| Outcome: | The proposed method surpasses architectural limitations and achieves higher accuracy on large-scale counting tasks. |