Challenge: Existing adapter-based transfer methods treat instruction-tuned models as passive targets . direct fine-tuning can disrupt this delicate balance and lead to instability or performance degradation.
Approach: They propose a framework that incorporates instruction-level guidance into task adaptation.
Outcome: The proposed framework outperforms direct fine-tuning and representative transfer-based baselines while maintaining robust generalization and favorable test-time scaling behavior.

Similar Papers

GiFT: Gibbs Fine-Tuning for Code Generation (2025.acl-long)

Copied to clipboard

Challenge: Training Large Language Models (LLMs) with synthetic data is a prevalent practice in code generation.
Approach: They propose a method to fine-tune large language models with code drawn from a conditional distribution, conditioned on a specific seed description.
Outcome: The proposed method improves performance on four datasets and shows that it can be used to fine-tune LLMs with code derived from the marginal distribution.
Tuna: Instruction Tuning using Feedback from Large Language Models (2023.findings-emnlp)

Copied to clipboard

Challenge: LLms like LLaMA have shown to be cost-effective for generating better responses . however, the instruction-tuned model has only seen one response per instruction .
Approach: They propose to fine tune an instruction-tuned LLM using probabilistic ranking and contextual ranking approaches to increase the likelihood of generating better responses.
Outcome: The proposed model improves on Super Natural Instructions, LMentry and Vicuna QA.
Demystifying Instruction Mixing for Fine-tuning Large Language Models (2024.acl-srw)

Copied to clipboard

Challenge: Instruction tuning is effective for aligning large language models with human instructions, but the procedure to optimizing the mixing of instruction datasets is still unclear.
Approach: They categorize instructions into three primary types: NLP downstream tasks, coding, and general chat.
Outcome: The proposed method improves performance of large language models (LLMs) but it is difficult to combine different instruction datasets to optimize overall performance.
From Language Modeling to Instruction Following: Understanding the Behavior Shift in LLMs after Instruction Tuning (2024.naacl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have achieved remarkable success in aligning with user intentions.
Approach: They develop local and global explanation methods and a feed-forward-based method for input-output attribution to investigate the impact of instruction tuning on user intentions.
Outcome: The proposed method compares explanations from pre-trained and instruction-tuned models . it empowers LLMs to recognize the instruction parts of user prompts, it encourages response generation .
Instruction-tuned Language Models are Better Knowledge Learners (2024.acl-long)

Copied to clipboard

Challenge: Large language models store factual knowledge in parameters, but it can become outdated as the work evolves . pre-instruction-tuning improves ability of LLMs to absorb knowledge from new documents .
Approach: They propose a method that instruction-tunes on questions prior to training on documents . they propose to use QA pairs to update factual knowledge of large language models .
Outcome: The proposed method outperforms instruction-tuning on documents by 17.8%.
Safeguard Fine-Tuned LLMs Through Pre- and Post-Tuning Model Merging (2025.findings-emnlp)

Copied to clipboard

Challenge: Fine-tuning large language models for downstream tasks often leads to catastrophic forgetting, notably degrading the safety of original alignments.
Approach: They propose to merge the weights of pre- and post-fine-tuned models to improve safety while enhancing performance.
Outcome: Experiments across different downstream tasks and models validate the method’s practicality and effectiveness.
LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have shown unprecedented performance across various tasks.
Approach: They propose an easy-to-use framework that integrates adapters into LLMs . they evaluate adapters on 14 datasets from two different reasoning tasks .
Outcome: The proposed framework can be used to fine-tune open-access language models with task-specific data and instruction data.
GIFT-SW: Gaussian noise Injected Fine-Tuning of Salient Weights for LLMs (2025.acl-long)

Copied to clipboard

Challenge: Recent studies show that a small subset of weights significantly impacts performance.
Approach: They propose a Gaussian noise-injected fine-tuning method that updates only salient weights while injecting Gausssian into non-salient weight.
Outcome: The proposed method outperforms full fine-tuning and PEFT methods under the same computational budget.
Unveiling the Generalization Power of Fine-Tuned Large Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated exceptional multitasking abilities, but the comprehensive effects of fine-tuning on the LLMs’ generalization ability are not fully understood.
Approach: They conduct extensive experiments across five distinct language tasks on different datasets to investigate whether fine-tuning affects the generalization ability intrinsic to LLMs.
Outcome: The proposed model can generalize to different domains and tasks by integrating the in-context learning strategy during fine-tuning on generation tasks.
RAISE: Reinforced Adaptive Instruction Selection For Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing selection methods rely on static, heuristic quality scores and are executed only once before training.
Approach: They propose a dynamic selection framework that integrates selection into every training step.
Outcome: The proposed framework integrates selection into every training step.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations