Challenge: Parameter-Efficient Fine-Tuning (PEFT) is an alternative to Full-Parameter Fine-tuning, but its effectiveness on complex tasks such as reasoning and instruction-following remains unclear.
Approach: They propose to use PEFT to reduce the number of trainable parameters while freezing the weights of LLMs.
Outcome: The proposed methods perform well on standard tasks, but weaknesses on complex and adversarial settings call for new directions beyond current paradigms.

Similar Papers

PEFT-Bench: A Parameter-Efficient Fine-Tuning Methods Benchmark (2026.eacl-long)

Copied to clipboard

Challenge: Parameter-Efficient Fine-Tuning (PEFT) methods reduce the number of trainable parameters while maintaining strong downstream performance.
Approach: They propose a unified benchmark for evaluating diverse PEFT methods on autoregressive LLMs.
Outcome: The proposed methods reduce trainable parameters while maintaining strong downstream performance.
Unlocking Parameter-Efficient Fine-Tuning for Low-Resource Language Translation (2024.findings-naacl)

Copied to clipboard

Challenge: Parameter-efficient fine-tuning (PEFT) methods are important in low-resource language (LRL) Neural Machine Translation (NMT) but their practical effectiveness varies significantly across different languages.
Approach: They evaluated the performance of 8 parameters-efficient fine-tuning methods with 15 architectures using the SacreBLEU score.
Outcome: The Houlsby+Inversion adapter outperforms the baseline architectures in both in-domain and out-domain tests and the Houlson+Inverter achieves the best performance overall.
From Bottom to Top: Extending the Potential of Parameter Efficient Fine-Tuning (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to fine-tune large language models primarily focus on the interaction between different layers, ignoring the fact that different layers store different information.
Approach: They propose a Parameter Efficient Fine-Tuning method which freeze pre-trained parameters and fine-tunes only a few task-specific parameters.
Outcome: The proposed methods reduce parameter count to nearly half by omitting fine-tuning in the middle layers.
When does Parameter-Efficient Transfer Learning Work for Machine Translation? (2022.emnlp-main)

Copied to clipboard

Challenge: Prior work indicates that parametric fine-tuning methods may not work as well for machine translation (MT).
Approach: They propose to use parameter-efficient fine-tuning methods to adapt large pre-trained models while only tuning a small number of parameters.
Outcome: The proposed methods outperform full fine-tuning for many downstream tasks when the parameter budget corresponds to 10% of the model parameters.
Semantic are Beacons: A Semantic Perspective for Unveiling Parameter-Efficient Fine-Tuning in Knowledge Learning (2024.findings-acl)

Copied to clipboard

Challenge: Parameter-Efficient Fine-Tuning (PEFT) methods allow efficient adaptation of Large Language Models (LLMs) to various downstream tasks, but their effectiveness diminishes when downstream tasks require accurate learning of specific knowledge.
Approach: They propose a method that fine-tunes a limited number of model parameters while keeping the majority of original parameters fixed.
Outcome: The proposed method is able to perform on open-source large language models and validates the semantic challenge in PEFT.
Towards Robust and Generalized Parameter-Efficient Fine-Tuning for Noisy Label Learning (2024.acl-long)

Copied to clipboard

Challenge: Parameter-efficient fine-tuning (PEFT) has enabled efficient optimization of cumbersome language models in real-world environments.
Approach: They propose a routing-based PEFT approach that adaptively activates PEFT modules.
Outcome: The proposed method is more sensitive to noise interference than other methods.
Punctuation-Steered Representation Fine-Tuning (2026.acl-short)

Copied to clipboard

Challenge: Existing methods for parameter-efficient fine-tuning (PeFT) are limited due to their prohibitive size and computational demands.
Approach: They propose a method that fine-tunes punctuation representations to achieve performance improvements.
Outcome: The proposed method improves performance by altering the representation space alone . but it results in suboptimal performance due to the effects of the method on the output .
Parameter-Efficient Language Model Tuning with Active Learning in Low-Resource Settings (2023.emnlp-main)

Copied to clipboard

Challenge: Pre-trained language models (PLMs) have ignited a surge in demand for effective fine-tuning techniques . data labeling is notoriously time-consuming and expensive, hindering the development of sizable labeled datasets .
Approach: They propose to use active learning to reduce labeling costs by minimizing label complexity . they find PEFT adapter modules have significant potential in low-resource settings .
Outcome: The proposed model outperforms FFT in low-resource settings and shows that it yields more stable representations of early and middle layers than FFT.
Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for fine-tuning large language models are inefficient and redundant . a light-PEFT framework can be used to prune redundant parameters during training .
Approach: They propose a parameter-efficient fine-tuning framework that freezes most parameters of the foundation model and finetuns only a small number of parameters.
Outcome: The proposed framework achieves training and inference speedup, reduces memory usage, and maintains comparable performance and plug-and-play feature of PEFT.
Revisiting Parameter-Efficient Tuning: Are We Really There Yet? (2022.emnlp-main)

Copied to clipboard

Challenge: Pretrained language models (PLMs) are used as backbones to be combined with additional parameters and finetuned on downstream tasks in an end-to-end manner.
Approach: They propose to use a fraction of parameters to tune pretrained language models (PLMs) this is the first comprehensive investigation into the training and evaluation of PETuning methods.
Outcome: The proposed methods have been validated and tested with a rigorous evaluation protocol and have shown that they are unstable and inconsistent.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations