Papers by Minseop Park
Quadapter: Adapter for GPT-2 Quantization (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Quantization-aware training (QAT) fine-tunes model parameters in response to the numerical error arising from quantization. |
| Approach: | They propose a quantization adapter that scales activations channel-wise to make activations quantization-friendly by scaling them channel- wise. |
| Outcome: | The proposed method prevents overfitting and improves quantization performance. |