Papers by Along He
HookMoE: A learnable performance compensation strategy of Mixture-of-Experts for LLM inference acceleration (2025.emnlp-main)
Copied to clipboard
| Challenge: | Mixture of Experts (MoE) models have been a promising paradigm for scaling model capacity through top-k routing mechanisms. |
| Approach: | They propose a plug-and-play single-layer compensation framework that strategically inserts a lightweight trainable Hook module immediately preceding selected transformer blocks. |
| Outcome: | The proposed framework reduces the number of activated experts by more than 50% and achieves a 1.42 inference speed-up during the prefill stage. |