Challenge: Existing data pruning methods for active learning are expensive and time-consuming.
Approach: They propose a plug-and-play data pruning strategy that leverages language models to prune the unlabeled pool.
Outcome: The proposed pruning strategy outperforms existing pruning methods on translation, sentiment analysis, topic classification, and summarization tasks on diverse datasets.

Similar Papers

DRPruning: Efficient Large Language Model Pruning through Distributionally Robust Optimization (2025.acl-long)

Copied to clipboard

Challenge: Structured pruning reduces model size but often causes uneven degradation across domains, leading to biased performance.
Approach: They propose a method that dynamically adjusts the data distribution during training to restore balanced performance across heterogeneous and multi-tasking data.
Outcome: Experiments in monolingual and multilingual settings show that the proposed method surpasses similarly sized models in pruning and continued pretraining over perplexity, downstream tasks, and instruction tuning.
On the Limitations of Language-targeted Pruning: Investigating the Calibration Language Impact in Multilingual LLM Pruning (2026.tacl-1)

Copied to clipboard

Challenge: Recent advances in large language model pruning have shown high predictive performance in post-training settings.
Approach: They conduct an empirical study on the performance and internal representation changes associated with pruning multilingual models for monolingual applications.
Outcome: The proposed pruning methods retain perplexity and yield high signal-to-noise ratios, but not consistently improve downstream tasks.
Towards Robust Pruning: An Adaptive Knowledge-Retention Pruning Strategy for Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Existing pruning strategies struggle to enhance robustness against adversarial attacks when continually increasing model sparsity and require a retraining process.
Approach: They propose a pruning strategy that replicates embedding space and feature space of dense language models and aims to conserve more pre-trained knowledge during the pruning process.
Outcome: The proposed pruning strategy replicates embedding space and feature space of dense language models, aiming to conserve more pre-trained knowledge during the pruning process.
FedSpaLLM: Federated Pruning of Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Existing pruning methods assume public access to calibration data, which is impractical for privacy-sensitive applications.
Approach: They propose a federated learning framework for pruning LLMs that prunes models locally based on private data while accounting for system heterogeneity and communication efficiency.
Outcome: The proposed framework reduces communication overhead and personalizes pruning process based on client resources in federated settings.
Data Pruning for Efficient Model Pruning in Neural Machine Translation (2023.findings-emnlp)

Copied to clipboard

Challenge: Large-scale pre-trained language models have demonstrated encouraging performance in various NLP tasks at the cost of over-parametrized networks and high memory requirements.
Approach: They combine data pruning with movement pruning for Neural Machine Translation to enable efficient fine-pruning by leveraging cross-entropy scores of individual training instances.
Outcome: The proposed pruning strategy outperforms other pruning methods on a translation task and shows that training cross-entropy scores can reduce the steps required for convergence and training time.
Pruning Foundation Models for High Accuracy without Retraining (2024.findings-emnlp)

Copied to clipboard

Challenge: Despite the superior performance of foundation models, it is challenging to deploy large language models in practical applications due to their massive parameters and computations.
Approach: They propose a pruning algorithm to prune LLMs in one-shot without retraining . they propose retrainable pruning algorithms to prune multiple weights in LLM .
Outcome: The proposed pruning methods perform better than baseline pruning methods on sparse and unstructured sparsity models.
One-for-All Pruning: A Universal Model for Customized Compression of Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing pruning methods for large language models (LLMs) focus on achieving high compression rates while maintaining model performance.
Approach: They propose a Univeral Model for Customized Compression (UniCuCo) which introduces a StratNet that learns to map arbitrary requests to their optimal pruning strategy.
Outcome: The proposed model is 28 times faster than baselines in processing 64 requests, while maintaining comparable accuracy to baselines.
Structured Pruning of Large Language Models (2020.emnlp-main)

Copied to clipboard

Challenge: Recent advances in language modeling have led to remarkable improvements on a variety of tasks.
Approach: They propose a generic, structured pruning approach by parameterizing each weight matrix and adaptively removing rank-1 components during training.
Outcome: The proposed method outperforms unstructured pruning and block pruning on language modeling tasks while achieving speedups during training and inference.
BlockPruner: Fine-grained Pruning for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have significant computational and memory costs associated with training and inference.
Approach: They propose a training-free structured pruning approach that targets redundancies in MHA and MLP blocks.
Outcome: The proposed pruning approach achieves more granular and effective pruning compared to state-of-the-art pruning methods.
LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning (2024.findings-acl)

Copied to clipboard

Challenge: Low-rank adaption (LoRA) is a low-level pruning method that can be expensive and slow to deploy.
Approach: They propose a low-rank adaption pruning framework that provides an accurate structured pruned model in a memory-efficient manner.
Outcome: The proposed pruning framework reduces perplexity and memory usage by 52.6% on LLaMA and T5 models while reducing memory usage.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations