Papers with LinguaSpec
Training-Free Adaptive Speculative Decoding via Linguistic Priors (2026.findings-acl)
Copied to clipboard
| Challenge: | Speculative decoding (SPD) is a promising technique to accelerate Large Language Models (LLMs). current approaches neglect the inherent heterogeneity of natural language and fail to distinguish between semantically-rich content and structurally-predictable syntax. |
| Approach: | They propose a training-free framework that leverages linguistic priors to enable adaptive drafting and verification. |
| Outcome: | The proposed framework significantly accelerates inference without additional training. |