Papers by Changjing Shang
Profiling-Free Mixed-Precision Quantization for MoE LLMs via Fuzzy Rule Interpolation (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models are scaling in size and capability, driving substantial computational and memory costs. |
| Approach: | They propose a mixed-precision quantization framework that uses fuzzy rule interpolation to predict quantization error from only sparse samples. |
| Outcome: | The proposed framework accelerates the profiling phase by up to 15.7 on DeepSeek-V2 while achieving comparable or slightly superior zero-shot accuracy. |