Papers by Somit Gupta
Do LLMs Really Need 10+ Thoughts for “Find the Time 1000 Days Later”? Towards Structural Understanding of LLM Overthinking (2026.acl-long)
Copied to clipboard
Xinliang Frederick Zhang, Anhad Mohananey, Alexandra Chronopoulou, Pinelopi Papalampidi, Somit Gupta, Tsendsuren Munkhdalai, Lu Wang, Shyam Upadhyay
| Challenge: | Existing studies on LLMs' thought processes are limited to superficial, profiling-based observations, failing to delve into their inner workings. |
| Approach: | They propose a utility-based definition of overthinking that moves beyond length-based metrics and provides a more insightful understanding of LLMs' thought progression. |
| Outcome: | The proposed model decomposes the LLM thought process into minimally complete sub-thoughts and identifies common thinking patterns for topically similar queries. |