Challenge: Existing knowledge distillation algorithms rely on the accessibility of the training dataset, which may be unavailable due to privacy issues.
Approach: They propose a data-free distillation method for a pre-trained transformer-based model that uses plug & play Embedding Guessing to craft pseudo embeddings from the teacher's hidden knowledge.
Outcome: The proposed method is the first data-free distillation framework designed for NLP tasks.

Similar Papers

Towards Zero-Shot Knowledge Distillation for Natural Language Processing (2021.emnlp-main)

Copied to clipboard

Challenge: Knowledge distillation (KD) is a common knowledge transfer algorithm used for model compression across a variety of deep learning based natural language processing (NLP) solutions.
Approach: They propose to use teacher training data for model compression . they investigate six tasks and find they can achieve between 75% and 92% of the teacher’s classification score while compressing the model 30 times.
Outcome: The proposed solution achieves between 75% and 92% of the teacher’s classification score while compressing the model 30 times.
MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation (2021.acl-long)

Copied to clipboard

Challenge: Recent studies have shown that the trillion parameter mark for pre-trained language models is not achievable without a change in training paradigm.
Approach: They propose a text-based adversarial training algorithm which enhances the performance of knowledge distillation by maximizing the divergence between teacher and student logits.
Outcome: The proposed algorithm outperforms competing adversarial learning and data augmentation baselines on the GLUE benchmark.
Cost-effective Distillation of Large Language Models (2023.findings-acl)

Copied to clipboard

Challenge: Existing knowledge distillation methods require pretraining of the teacher on task-specific datasets, which can be costly for large and unstable for small datasets.
Approach: They propose an approach to improve knowledge distillation by a loss-agnostic approach to task and model architecture.
Outcome: The proposed method achieves competitive results across a range of tasks, especially for tasks with smaller datasets.
Differentially Private Knowledge Distillation via Synthetic Text Generation (2024.findings-acl)

Copied to clipboard

Challenge: Large Language models (LLMs) are achieving state-of-the-art performance in many downstream tasks, but data privacy is a major challenge for practitioners.
Approach: They propose a differentially private knowledge distillation algorithm that exploits the knowledge of a teacher LLM and a student's output distribution.
Outcome: The proposed algorithm significantly improves the utility over baselines on the Big Patent dataset, with strong privacy parameters, =2.
uDistil-Whisper: Label-Free Data Filtering for Knowledge Distillation in Low-Data Regimes (2025.naacl-long)

Copied to clipboard

Challenge: Recent work on distilling Whisper’s knowledge into small models using pseudo-labels shows promising performance while reducing the size by up to 50%.
Approach: They propose a framework that distills Whisper’s knowledge into small models using pseudo-labels and reduces the size by up to 50%.
Outcome: The proposed model outperforms the teacher model by 5-7 WER points and is 25-50% more efficient when scaling the data.
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains (2021.acl-long)

Copied to clipboard

Challenge: Pre-trained language models have been successful in NLP tasks, but their large size and long inference time limit their deployment in real-time applications.
Approach: They propose a meta-teacher model that captures transferable knowledge across domains and passes it to students.
Outcome: The proposed model can distill large teacher models into small student models with guidance from the meta-teacher.
Adaptive Contrastive Knowledge Distillation for BERT Compression (2023.findings-acl)

Copied to clipboard

Challenge: Existing knowledge distillation methods for BERT implicitly learn discriminative student features by mimicking the teacher features.
Approach: They propose a new knowledge distillation approach called adaptive contrastive knowledge distilling for BERT compression using hidden state features in BERT as explicit supervision to learn discriminative student features.
Outcome: The proposed approach improves on multiple natural language processing tasks.
Distillation of encoder-decoder transformers for sequence labelling (2023.findings-eacl)

Copied to clipboard

Challenge: despite the strong trend in NLP to explore the use of large language models, there is still limited work evaluating prompting and decoding mechanisms for SL tasks.
Approach: They propose a hallucination-free framework for sequence tagging that is especially suited for distillation.
Outcome: The proposed framework performs well across multiple sequence labelling datasets and in a few-shot learning scenario.
TinyBERT: Distilling BERT for Natural Language Understanding (2020.findings-emnlp)

Copied to clipboard

Challenge: Pre-trained language models are computationally expensive and difficult to efficiently execute on resource-restricted devices.
Approach: They propose a Transformer distillation method that performs Transformer distillations at pre-training and task-specific learning stages.
Outcome: The proposed method accelerates inference and reduces model size while maintaining accuracy.
AD-KD: Attribution-Driven Knowledge Distillation for Language Model Compression (2023.acl-long)

Copied to clipboard

Challenge: Existing knowledge distillation methods focus on the transfer of model-specific knowledge but overlook data-specific information.
Approach: They propose an attribution-driven knowledge distillation approach which explores the token-level rationale behind the teacher model and transfers attribution knowledge to the student model.
Outcome: The proposed method outperforms state-of-the-art methods on the GLUE benchmark and shows that it is more efficient than existing methods.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations