Challenge: Knowledge distillation (KD) is a promising solution for large language models, but their deployment remains computationally expensive.
Approach: They propose a framework which iteratively balances training data within a fixed computational budget and enables the transfer of knowledge from expensive teacher LLMs to smaller student models.
Outcome: The proposed framework achieves state-of-the-art performance across diverse long-tailed datasets, enhancing both the efficiency and efficacy of the distilled models.

Similar Papers

XtremeDistil: Multi-stage Distillation for Massive Multilingual Models (2020.acl-main)

Copied to clipboard

Challenge: Existing work on pre-trained language models focuses on reducing the size of these models into shallow ones.
Approach: They propose a knowledge distillation technique that leverages teacher internal representations to reduce the size of pre-trained language models.
Outcome: The proposed method outperforms previous methods in multilingual Named Entity Recognition (NER) it reduces the size of teacher models by 35x while retaining 95% of its F1 score.
Beyond One-Step Distillation: Bridging the Capacity Gap in Small Language Models via Multi-Step Knowledge Transfer (2026.eacl-srw)

Copied to clipboard

Challenge: Large Language Models (LLMs) excel across diverse tasks but remain too large for efficient on-device deployment.
Approach: They revisit multi-step knowledge distillation as an effective remedy . they demonstrate that MSKD improves ROUGE-L and perplexity over single-step approaches .
Outcome: The proposed approach improves ROUGE-L and perplexity over single-step approaches . large language models are too large for efficient on-device deployment, the authors show .
f-Divergence Minimization for Sequence-Level Knowledge Distillation (2023.acl-long)

Copied to clipboard

Challenge: Existing knowledge distillation approaches focus on minimizing a generalized f-divergence function.
Approach: They propose a framework which formulates sequence-level knowledge distillation as minimizing a generalized f-divergence function.
Outcome: The proposed framework outperforms existing methods and reduces intractable divergence to word-level losses.
MCC-KD: Multi-CoT Consistent Knowledge Distillation (2023.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated remarkable abilities in complex reasoning through chain of thought (CoT) prompting.
Approach: They propose to generate multiple rationales for each question and enforce consistency among their predictions by minimizing the bidirectional KL-divergence between the answer distributions.
Outcome: The proposed model achieves superior performance on in-distribution and commonsense reasoning benchmarks.
Revisiting Knowledge Distillation for Autoregressive Language Models (2024.acl-long)

Copied to clipboard

Challenge: Autoregressive language models (LMs) are expensive and memory intensive, preventing the development of industrial applications.
Approach: They propose an adaptive teaching approach to improve the KD of autoregressive language models by distilling knowledge into a small student model.
Outcome: The proposed method can achieve consistent and significant performance gains across all model types and sizes.
Pre-training Distillation for Large Language Models: A Design Space Exploration (2025.acl-long)

Copied to clipboard

Challenge: Knowledge distillation (KD) aims to transfer knowledge from a large teacher model to a smaller student model for model compression.
Approach: They extend knowledge distillation to the pre-training phase of large language models . they first conduct an experiment using a teacher LLM to distill a 1.9B student LLM .
Outcome: The proposed model can be used to distill a 1.9B student model using a teacher LLM.
Cost-effective Distillation of Large Language Models (2023.findings-acl)

Copied to clipboard

Challenge: Existing knowledge distillation methods require pretraining of the teacher on task-specific datasets, which can be costly for large and unstable for small datasets.
Approach: They propose an approach to improve knowledge distillation by a loss-agnostic approach to task and model architecture.
Outcome: The proposed method achieves competitive results across a range of tasks, especially for tasks with smaller datasets.
Enhancing Knowledge Distillation of Large Language Models through Efficient Multi-Modal Distribution Alignment (2025.coling-main)

Copied to clipboard

Challenge: Existing knowledge distillation techniques for large language models are causing difficulties for student models to learn multi-modal probability distributions.
Approach: They propose a ranking loss-based knowledge distillation method that encourages consistency of the ranking of peak predictions between teacher and student models.
Outcome: The proposed method improves student models' ability to learn multi-modal distributions.
Knowledge Distillation for Language Models (2025.naacl-tutorial)

Copied to clipboard

Challenge: Knowledge distillation (KD) aims to transfer knowledge from a teacher to a student . this tutorial will cover topics ranging from LLM sequence compression to LLM self-distillation .
Approach: They propose to introduce intermediate-layer matching and prediction matching . they will then present advanced techniques such as reinforcement learning-based KD and multi-teacher distillation .
Outcome: This tutorial aims to provide participants with a comprehensive understanding of the techniques and applications of knowledge distillation for language models.
Generation-Distillation for Efficient Natural Language Understanding in Low-Data Settings (D19-61)

Copied to clipboard

Challenge: Recent research points to knowledge distillation as a potential solution for NLU tasks.
Approach: They propose a training approach that distills large finetuned LMs into a small network using unlabeled training examples.
Outcome: The proposed approach outperforms BERT training approaches while using 300 times fewer parameters.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations