Challenge: Transfer learning methods have shown that reusing non-task-specific knowledge can speed up task-specific learning in the latter.
Approach: They propose to port whole functional modules that encode task-specific knowledge from one model to another using parameter-efficient finetuning techniques.
Outcome: The proposed methods outperform the two alternatives, but there are differences between the two.

Similar Papers

Is Modularity Transferable? A Case Study through the Lens of Knowledge Distillation (2024.lrec-main)

Copied to clipboard

Challenge: Existing approaches to modularity are limited to the case of pre-trained modules in a pre-training language model.
Approach: They propose a method that allows the transfer of pre-trained PEFT modules between incompatible PLMs without any change in the inference complexity.
Outcome: The proposed method allows the transfer of modules between incompatible PLMs without any change in the inference complexity.
When does Parameter-Efficient Transfer Learning Work for Machine Translation? (2022.emnlp-main)

Copied to clipboard

Challenge: Prior work indicates that parametric fine-tuning methods may not work as well for machine translation (MT).
Approach: They propose to use parameter-efficient fine-tuning methods to adapt large pre-trained models while only tuning a small number of parameters.
Outcome: The proposed methods outperform full fine-tuning for many downstream tasks when the parameter budget corresponds to 10% of the model parameters.
Parameter-efficient Weight Ensembling Facilitates Task-level Knowledge Transfer (2023.acl-short)

Copied to clipboard

Challenge: Recent studies show that large pre-trained language models can be adapted to particular tasks in a parameter-efficient manner.
Approach: They propose to use lightweight parameters to transfer them between tasks to obtain similarity between tasks.
Outcome: The proposed methods show an improvement of 5%8% over baselines and could largely facilitate task-level knowledge transfer.
PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning (2024.findings-acl)

Copied to clipboard

Challenge: Parameter-efficient fine-tuning (PEFT) is an effective method for adapting pre-trained language models to various tasks efficiently.
Approach: They propose a parameter-efficient fine-tuning framework that captures transferable knowledge as a weighted combination of adapters trained on source tasks.
Outcome: The proposed method yields stable improvements over full fine-tuning and knowledge transferring methods on a broad range of tasks over 17 datasets.
Adapt Once, Thrive with Updates: Transferable Parameter-Efficient Fine-Tuning on Evolving Base Models (2025.acl-long)

Copied to clipboard

Challenge: Parameter-efficient fine-tuning (PEFT) is a common method for fine- tuning large language models . however, once updated, PEFT modules suffer performance degradation on newer versions .
Approach: They propose a method that enhances the PEFT module by focusing on the task-specific pattern while reducing its dependence on certain knowledge in the base model.
Outcome: Experiments show that PEFT modules can maintain performance on updated models without re-tuning . the proposed approach can be used in real-world applications with large model sizes .
Hit the Nail on the Head: Parameter-Efficient Multi-task Tuning via Human Language Intervention (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent studies show that PEFT on small pre-trained language models improves multitasking capabilities.
Approach: They propose a multi-task learning framework that enables transfer of prior knowledge across tasks . they attach task descriptions to input samples and map them to task embeddings .
Outcome: The proposed method improves performance on a T5 model and in decoder-only models .
An Empirical Study on the Transferability of Transformer Modules in Parameter-efficient Fine-tuning (2022.emnlp-main)

Copied to clipboard

Challenge: Parameter-efficient fine-tuning is a computationally expensive process . introducing new parameters to an already-large model can be considered a drawback.
Approach: They investigate the capability of different transformer modules in transferring knowledge from a pre-trained model to a downstream task.
Outcome: The proposed methods show that each transformer module is a winning ticket . they show that with only 0.003% updateable parameters, they can show acceptable performance on target tasks.
PEFT-Bench: A Parameter-Efficient Fine-Tuning Methods Benchmark (2026.eacl-long)

Copied to clipboard

Challenge: Parameter-Efficient Fine-Tuning (PEFT) methods reduce the number of trainable parameters while maintaining strong downstream performance.
Approach: They propose a unified benchmark for evaluating diverse PEFT methods on autoregressive LLMs.
Outcome: The proposed methods reduce trainable parameters while maintaining strong downstream performance.
Towards Robust and Generalized Parameter-Efficient Fine-Tuning for Noisy Label Learning (2024.acl-long)

Copied to clipboard

Challenge: Parameter-efficient fine-tuning (PEFT) has enabled efficient optimization of cumbersome language models in real-world environments.
Approach: They propose a routing-based PEFT approach that adaptively activates PEFT modules.
Outcome: The proposed method is more sensitive to noise interference than other methods.
Know Where You’re Going: Meta-Learning for Parameter-Efficient Fine-Tuning (2023.findings-acl)

Copied to clipboard

Challenge: Existing studies on parameter-efficient fine-tuning methods require additional measures after pre-training and before fine-uning.
Approach: They propose to take parameter-efficient fine-tuning into consideration after pre-training and before fine-uning and use meta-learning to prime a model specifically for parameter-efficiency.
Outcome: The proposed method improves on a pre-trained model with certain modifications and achieves 4.96 points on cross-lingual NER fine-tuning.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations