Challenge: Large Language Models (LLMs) have demonstrated impressive performance on a range of Natural Language Processing (NLP) tasks.
Approach: They propose a dynamic quantization strategy that reduces the amount of memory operations and reduces arithmetic cost by 20.95 on two translation tasks and three classification tasks.
Outcome: The proposed model reduces the amount of arithmetic operations by 20.95 and the number of DRAM operations by 2.55 on two translation tasks and three classification tasks.

Similar Papers

Self-Distilled Quantization: Achieving High Compression Rates in Transformer-Based Language Models (2023.acl-short)

Copied to clipboard

Challenge: Existing methods for quantization-aware training and quantization for learning have limitations in dealing with accumulative quantization errors.
Approach: They propose a method that minimizes accumulative quantization errors and outperforms baselines by distilling knowledge from a fine-tuned teacher network.
Outcome: The proposed method minimizes accumulative quantization errors and outperforms baselines on the XGLUE benchmark.
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Several post-training quantization methods have been shown to perform well down to 8-bits.
Approach: They propose a data-free distillation method that leverages generations produced by the pre-trained model to quantize any generative model independent of its training data.
Outcome: The proposed method outperforms SoTA PTQ and LLaMA models at low bit precision.
Extremely Low Bit Transformer Quantization for On-Device Neural Machine Translation (2020.findings-emnlp)

Copied to clipboard

Challenge: Quantization is an effective technique to address heavy computation load and memory overhead during inference.
Approach: They propose a low-bit quantization strategy to represent Transformer weights by an extremely low number of bits.
Outcome: The proposed model achieves 11.8 smaller model size than baseline model, with less than -0.5 BLEU.
Understanding and Overcoming the Challenges of Efficient Transformer Quantization (2021.emnlp-main)

Copied to clipboard

Challenge: Recent advances in transformer quantization have shown remarkable improvement in many Natural Language Processing tasks and beyond.
Approach: They propose a novel quantization scheme for transformers that can be quantized to ultra-low bit-widths, leading to significant memory savings with a minimum accuracy loss.
Outcome: The proposed methods achieve state-of-the-art results on the GLUE benchmark using BERT, while preserving memory and accuracy.
LRQ: Optimizing Post-Training Quantization for Large Language Models by Learning Low-Rank Weight-Scaling Matrices (2025.naacl-long)

Copied to clipboard

Challenge: Existing methods for quantizing weights and activations of large language models suffer from non-negligible accuracy drops, especially on massive multitask language understanding.
Approach: They propose a weight-activation quantization method that reconstructs the outputs of an intermediate Transformer block by leveraging low-rank weight-scaling matrices.
Outcome: The proposed method reduces the complexity of the weight-activation quantization techniques while achieving high throughput and reducing inference costs.
A Frustratingly Easy Post-Training Quantization Scheme for LLMs (2023.emnlp-main)

Copied to clipboard

Challenge: Efficient inference is crucial for hyper-scale AI models, including large language models, as their parameter count continues to increase for enhanced performance.
Approach: They propose a quantization scheme that fully utilizes the Transformer structure used in large language models to minimize the frequency of DRAM access while exploiting the parallelism of operations.
Outcome: The proposed method minimizes the frequency of DRAM access while exploiting the parallelism of operations through a dense matrix format.
DL-QAT: Weight-Decomposed Low-Rank Quantization-Aware Training for Large Language Models (2024.emnlp-industry)

Copied to clipboard

Challenge: Quantization-aware Training (QAT) is a popular technique for reducing memory usage and improving computational efficiency in large language models.
Approach: They propose a weight-decomposed low-rank quantization-aware training approach that integrates QAT with a group-specific quantization magnitude adjustment.
Outcome: The proposed method outperforms the state-of-the-art method on LLaMA and LLama2 models.
Beyond Dynamic Quantization: An Efficient Static Hierarchical Mix-precision Framework for Near-Lossless LLM Compression (2025.emnlp-industry)

Copied to clipboard

Challenge: Existing methods for dynamic quantization are hardware-unfriendly and often lead to large quantization errors in static scenarios.
Approach: They propose a Static Hierarchical Mix-precision Quantization method which quantifies both inter-layer and intra-layer sensitivity through unified derivations involving Hessian.
Outcome: The proposed method achieves 75.58% on zero-shot reasoning tasks while yielding average speedup of 2.86.
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Recent research has focused on pushing weight-only quantization to extremely low-bit due to numerical representation limitations.
Approach: They propose a vector-based quantization approach that pushes LLMs to extremely low-bit . they propose scalar-based weight quantization that reduces memory requirements and optimizes storage costs .
Outcome: The proposed method reduces model quantization perplexity by 0.01-0.34 on LLaMA-2, 0.38-0.68 on mistral-7B, 4.41-7.34, on llaMA-3 on QA tasks on average.
EfficientQAT: Efficient Quantization-Aware Training for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Quantization-aware training (QAT) is a low-bit training solution that requires substantial training resources.
Approach: They propose an algorithm that reduces memory consumption by low-bit representations with minimal accuracy loss.
Outcome: EfficientQAT achieves 2-bit Llama-2-70B model on single GPU in 41 hours . compared to previous methods, it obtains model with less than 3 points accuracy degradation .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations