Papers by Jungyoub Cha
SpecExtend: A Drop-in Enhancement for Speculative Decoding of Long Sequences (2026.findings-acl)
Copied to clipboard
| Challenge: | Speculative decoding performance degrades as input length increases, with significant drops even at moderate lengths. |
| Approach: | They propose a drop-in enhancement that improves speculative decoding on long sequences without additional training. |
| Outcome: | The proposed enhancement accelerates speculative decoding by up to 2.84 on 16K-token long document summarization and up to 3.86 on long-form reasoning while preserving the short-input performance of state-of-the-art frameworks. |