Papers by Decheng Wu
Sherry: Hardware-Efficient 1.25-Bit Ternary Quantization via Fine-grained Sparsification (2026.acl-long)
Copied to clipboard
| Challenge: | ternary quantization is a powerful solution for resource-constrained edge devices . current implementations suffer from a fundamental misalignment with commodity hardware . |
| Approach: | They propose a hardware-efficient ternary quantization framework that packs weights into five bits to restore power-of-two alignment. |
| Outcome: | The proposed framework reduces weights to -1, 0, +1 while preserving power-of-two alignment. |
EasyQuant: An Efficient Data-free Quantization Algorithm for LLMs (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent work has shown that large language models are superior to conventional methods in various tasks. |
| Approach: | They propose a data-independent quantization algorithm that leaves outliers in the weight and quantization ranges . they find the algorithm runs over 10 times faster than the data-dependent methods . |
| Outcome: | The proposed method runs over 10 times faster than the data-dependent methods. |