| Challenge: | Existing methods to enhance pre-trained language models' ability to follow instructions are limited due to the simultaneous handling of varying instruction complexities. |
| Approach: | They propose a phased instruction fine-tuning method that posits that the transition of a pre-trained language model from simple next-word prediction to sophisticated instruction following is a gradual learning process. |
| Outcome: | The proposed method surpasses the one-off instruction fine-tuning method in win rate and validates the hypothesis of progressive alignment. |
Similar Papers
Revisiting Instruction Fine-tuned Model Evaluation to Guide Industrial Applications (2023.emnlp-main)
Copied to clipboard
| Challenge: | Instruction fine-tuned (IFT) models are gaining traction in industrial NLP to unlock task-specific performance gains and strengthen model alignment with industry requirements. |
| Approach: | They propose to use instruction fine-tuned (IFT) models to enhance the zero-shot capabilities of Large Language Models (LLMs) they also propose to leverage IFT models to analyze the trade-offs that emerge in industrial settings. |
| Outcome: | The proposed model is well adapted to new evaluation metric requirements, and offers practical insights for real-world LLM deployment. |
Advancing Language Models through Instruction Tuning: Recent Progress and Challenges (2025.emnlp-tutorials)
Copied to clipboard
| Challenge: | tutorial addresses three critical questions within the field of instruction tuning: (1) What are the current focal points in instruction tuning research? (2) What are best practices in training an instruction-following model? (3) What new challenges have emerged? |
| Approach: | This tutorial presents a systematic overview of recent advances in instruction tuning. |
| Outcome: | The tutorial covers different stages in model training: supervised fine-tuning, preference optimization, and reinforcement learning. |
Exploring Two-Phase Continual Instruction Fine-tuning for Multilingual Adaptation in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | A key challenge for Large Language Models (LLMs) is improving their Multilingual instruction-following ability over time without deteriorating their ability in languages they already excel at, typically English. |
| Approach: | They propose a two-phase Continual Fine-tuning setup to improve a model's Multilingual adaptability by comparing an English-only LLM with a multilingual instruction dataset. |
| Outcome: | The proposed model improves on two-phase Continual Fine-tuning (CFT) setups on a multilingual instruction dataset. |
Learning or Self-aligning? Rethinking Instruction Fine-tuning (2024.acl-long)
Copied to clipboard
| Challenge: | Instruction fine-tuning (IFT) is a crucial phase in building large language models (LLMs). |
| Approach: | They propose a knowledge intervention framework to decouple the potential underlying factors of IFT and enable individual analysis of different factors. |
| Outcome: | The proposed framework decouples the potential underlying factors of IFT, enabling individual analysis of different factors. |
Dynamics of Instruction Fine-Tuning for Chinese Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Instruction tuning is a burgeoning method to elicit the general intelligence of Large Language Models. |
| Approach: | They investigate the effects of data quantity, model size, and data construction methods on instruction tuning for Chinese LLMs. |
| Outcome: | The proposed model includes over 40,000 high-quality instruction instances covering ten underlying abilities. |
Disperse-Then-Merge: Pushing the Limits of Instruction Tuning via Alignment Tax Reduction (2024.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models may not follow human instructions and produce toxic, hallucinated, or biased content. |
| Approach: | They propose a disperse-then-merge framework that dispersers instruction-following data into portions and trains multiple sub-models using different data portions. |
| Outcome: | The proposed framework outperforms data curation and training regularization on standard knowledge and reasoning benchmarks. |
Fine-Tuning Large Language Models with Sequential Instructions (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing instruction-tuned models struggle to adhere to a query with multiple intentions, which impairs their performance when the completion of several tasks is demanded by a single command. |
| Approach: | They develop an automatic process that turns existing data into diverse and complex task chains and a new benchmark to evaluate a model’s ability to follow all the instructions in a sequence. |
| Outcome: | The proposed model can follow instructions better and deliver higher results in coding, maths, and open-ended generation. |
Instruction Position Matters in Sequence Generation with Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) can perform conditional sequence generation tasks, such as translation or summarization, through instruction fine-tuning. |
| Approach: | They propose to shift the position of task instructions after the input sentences to enhance the model's instruction-following capability. |
| Outcome: | The proposed method outperforms traditional settings across various model scales (1B / 7B & 13B) and different sequence generation tasks (translation and summarization) without any additional data or annotation costs. |
M2Lingual: Enhancing Multilingual, Multi-Turn Instruction Alignment in Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches to collect instruction fine-tuning data are limited due to their toxicity, privacy and toxicity concerns. |
| Approach: | They propose to use a two-step taxonomy to transform a small set of human written instructions into complex and challenging conversations. |
| Outcome: | M2Lingual has 175K conversations across 70 languages with a balanced mix of high, low and mid-resourced languages. |
Fine-Grained Data Ordering Improves Fine-Tuning for Large Language Models (2026.findings-acl)
Copied to clipboard
Xiaomeng Hu, Yixuan Tang, Haoze Li, Hao Chen, Qi Zhang, Zhanming Shen, Yiming Zhang, Haobo Wang, Junbo Zhao
| Challenge: | Prior work focused on data preprocessing, focusing on filtering and cleaning data . a study aimed to improve fine-grained scheduling of data order in epochs . |
| Approach: | They propose a fine-grained scheduling method of data order in epochs to fill this gap . they define data difficulty based on relevance between data and model . |
| Outcome: | The proposed method improves on pre-training and small-scale fine-tuning experiments 2.4% over baselines. |