Challenge: Parameter-efficient fine-tuning is a computationally expensive process . introducing new parameters to an already-large model can be considered a drawback.
Approach: They investigate the capability of different transformer modules in transferring knowledge from a pre-trained model to a downstream task.
Outcome: The proposed methods show that each transformer module is a winning ticket . they show that with only 0.003% updateable parameters, they can show acceptable performance on target tasks.

Similar Papers

DimA: A Parameter-efficient Fine-tuning Method with Knowledge Transfer Based on Transformer (2024.lrec-main)

Copied to clipboard

Challenge: Pre-trained language models (PLMs) have demonstrated impressive performance across various downstream tasks, but fine-tuning is computationally expensive and storage-intensive.
Approach: They propose a parameter-efficient method called DimA which enhances the transformer architecture by increasing the dimensionality.
Outcome: The proposed method achieves state-of-the-art results in GLUE and XSUM tasks while utilizing less than 1% of the original model’s parameters.
Know Where You’re Going: Meta-Learning for Parameter-Efficient Fine-Tuning (2023.findings-acl)

Copied to clipboard

Challenge: Existing studies on parameter-efficient fine-tuning methods require additional measures after pre-training and before fine-uning.
Approach: They propose to take parameter-efficient fine-tuning into consideration after pre-training and before fine-uning and use meta-learning to prime a model specifically for parameter-efficiency.
Outcome: The proposed method improves on a pre-trained model with certain modifications and achieves 4.96 points on cross-lingual NER fine-tuning.
When does Parameter-Efficient Transfer Learning Work for Machine Translation? (2022.emnlp-main)

Copied to clipboard

Challenge: Prior work indicates that parametric fine-tuning methods may not work as well for machine translation (MT).
Approach: They propose to use parameter-efficient fine-tuning methods to adapt large pre-trained models while only tuning a small number of parameters.
Outcome: The proposed methods outperform full fine-tuning for many downstream tasks when the parameter budget corresponds to 10% of the model parameters.
Choose Your Transformer: Improved Transferability Estimation of Transformer Models on Classification Tasks (2024.findings-acl)

Copied to clipboard

Challenge: Existing models for NLP tasks require fine-tuning, but it is computationally infeasible.
Approach: They propose an approach that inexpensively estimates a ranking of the expected performance of a given set of transformer language models for a specific task.
Outcome: The proposed model improves the Pearson correlation coefficient between the true model ranks and the estimate.
Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks (2021.acl-long)

Copied to clipboard

Challenge: State-of-the-art parameter-efficient fine-tuning methods rely on introducing adapter modules between the layers of a pretrained language model.
Approach: They propose a framework that can learn adapter parameters for all layers and tasks by generating them using shared hypernetworks.
Outcome: The proposed framework improves performance on the well-known GLUE benchmark while adding only 0.29% parameters per task.
Not All Adapters Matter: Selective Adapter Freezing for Memory-Efficient Fine-Tuning of Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Existing methods for fine-tuning pre-trained models impose substantial resource usage.
Approach: They propose a parameter-efficient fine-tuning method that freezes adapters early to reduce resource usage while maintaining performance.
Outcome: The proposed method reduces memory usage, computation amount, and training time by 42.85%, 34.59%, and 11.82% while maintaining performance.
Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention (2022.findings-naacl)

Copied to clipboard

Challenge: Existing methods to fine-tune pre-trained language models are parameter efficient . fine- tuning the models requires multiple copies of the parameters, which is inefficient.
Approach: They propose to use kernel-based adapters to tune only a few parameters while freezing the rest of the parameters.
Outcome: The proposed methods achieve or improve strong performance over a diverse set of natural language generation and understanding tasks.
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation (2021.emnlp-main)

Copied to clipboard

Challenge: a series of experiments show that fine-tuning only the cross-attention parameters is nearly as effective as fine-timing all parameters.
Approach: They conduct experiments to fine-tune a translation model on data where either the source or target language has changed.
Outcome: The proposed model can be trained to several new languages with reduced parameter storage overhead.
Modular and Parameter-Efficient Fine-Tuning for NLP Models (2022.emnlp-tutorials)

Copied to clipboard

Challenge: State-of-the-art language models in NLP perform best when fine-tuned even on small datasets.
Approach: They provide an overview of parameter-efficient fine-tuning methods and highlight similarities and differences . they highlight benefits and usage scenarios of a neglected property of parameter efficient models .
Outcome: This paper provides an overview of parameter-efficient fine-tuning methods . it highlights similarities and differences by presenting them in a unified view .
From Bottom to Top: Extending the Potential of Parameter Efficient Fine-Tuning (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to fine-tune large language models primarily focus on the interaction between different layers, ignoring the fact that different layers store different information.
Approach: They propose a Parameter Efficient Fine-Tuning method which freeze pre-trained parameters and fine-tunes only a few task-specific parameters.
Outcome: The proposed methods reduce parameter count to nearly half by omitting fine-tuning in the middle layers.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations