Papers by Sanjay Podder
Benchmarking the Energy Savings with Speculative Decoding Strategies (2026.findings-eacl)
Copied to clipboard
Rohit Dutta, Paramita Koley, Soham Poddar, Janardan Misra, Sanjay Podder, Naveen Balani, Saptarshi Ghosh, Niloy Ganguly
| Challenge: | Existing studies on speculative decoding have focused on the energy requirements of these models, despite their utility and utility. |
| Approach: | They propose to analyze the energy requirements of speculative decoding strategies and analyze how various factors influence the energy optimizations. |
| Outcome: | The proposed approach reduces decoding time while offloading a substantial portion of the sequential generation to a smaller, more efficient model. |