Papers by Jinsong Shu
MM-ShiftKV: Decode-Aware Prefill-Stage KV Selection for Multimodal Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent work suggests a prefill-stage KV cache selection method to estimate KV importance from prefilling statistics. |
| Approach: | They propose a training-free, decode-aware and strictly prefill-only KV selection method that retains key-value caching for decoding . |
| Outcome: | The proposed method outperforms existing methods under tight cache budgets on multimodal benchmarks. |