Don’t Half-listen: Capturing Key-part Information in Continual Instruction Tuning (2025.acl-long)
Copied to clipboard
Yongquan He, Wenyuan Zhang, Xuancheng Huang, Peng Zhang, Lingxun Meng, Xiang Zhou, Ke Zeng, Xunliang Cai
| Challenge: | Existing methods to improve instruction tuning for large language models may cause catastrophic forgetting (CF) CF is a problem where previously learned abilities are degraded . |
| Approach: | They propose a continual instruction tuning method that uses key-part information gain to replay data and refine training objective. |
| Outcome: | The proposed method achieves superior performance on both seen and held-out tasks. |
Similar Papers
InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions (2024.naacl-long)
Copied to clipboard
| Challenge: | In order to perform downstream tasks, Large Language Models (LLMs) need continual adaptation without catastrophic forgetting. |
| Approach: | They propose a new paradigm that allows for continual adaptation without catastrophic forgetting . they propose to replay previous data based on task similarity with instructions . |
| Outcome: | The proposed method improves performance over 16 tasks with different training orders. |
CITB: A Benchmark for Continual Instruction Tuning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for instruction tuning do not leverage the rich natural language instructions. |
| Approach: | They propose to use a benchmark to study how instruction tuning works in CL tasks. |
| Outcome: | The proposed method can achieve similar or better results than existing CL methods. |
HiDe-LLaVA: Hierarchical Decoupling for Continual Instruction Tuning of Multimodal Large Language Model (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve instructionfollowing performance of MLLMs often trade off memory efficiency for performance gains, compromising overall efficiency. |
| Approach: | They propose a task-specific expansion and task-general fusion framework based on variations in Centered Kernel Alignment (CKA) similarity across different model layers when trained on diverse datasets. |
| Outcome: | The proposed framework improves performance compared to existing benchmarks. |
FOREVER: Forgetting Curve-Inspired Memory Replay for Language Model Continual Learning (2026.acl-long)
Copied to clipboard
Yujie Feng, Hao Wang, Jian Li, Xu Chu, Zhaolu Kang, Yiran Liu, Yasha Wang, Philip S. Yu, Xiao-Ming Wu
| Challenge: | Continual learning (CL) for large language models (LLMs) aims to enable sequential knowledge acquisition without catastrophic forgetting. |
| Approach: | They propose a framework that aligns replay schedules with a model-centric notion of time. |
| Outcome: | Experiments on three benchmarks show that FOREVER consistently mitigates catastrophic forgetting. |
Exploring Two-Phase Continual Instruction Fine-tuning for Multilingual Adaptation in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | A key challenge for Large Language Models (LLMs) is improving their Multilingual instruction-following ability over time without deteriorating their ability in languages they already excel at, typically English. |
| Approach: | They propose a two-phase Continual Fine-tuning setup to improve a model's Multilingual adaptability by comparing an English-only LLM with a multilingual instruction dataset. |
| Outcome: | The proposed model improves on two-phase Continual Fine-tuning (CFT) setups on a multilingual instruction dataset. |
Instruction-tuned Language Models are Better Knowledge Learners (2024.acl-long)
Copied to clipboard
Zhengbao Jiang, Zhiqing Sun, Weijia Shi, Pedro Rodriguez, Chunting Zhou, Graham Neubig, Xi Lin, Wen-tau Yih, Srini Iyer
| Challenge: | Large language models store factual knowledge in parameters, but it can become outdated as the work evolves . pre-instruction-tuning improves ability of LLMs to absorb knowledge from new documents . |
| Approach: | They propose a method that instruction-tunes on questions prior to training on documents . they propose to use QA pairs to update factual knowledge of large language models . |
| Outcome: | The proposed method outperforms instruction-tuning on documents by 17.8%. |
LongForm: Effective Instruction Tuning with Reverse Instructions (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work on instruction tuning relies on expensive human annotation and crowd-sourced datasets with alignment issues. |
| Approach: | They propose a method to generate instructions via LLMs from human-written corpus examples using reverse instructions. |
| Outcome: | The proposed method outperforms larger language models without instruction tuning on tasks such as story/recipe generation and long-form question answering. |
Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for instruction tuning do not include associating instructions with existing datasets. |
| Approach: | They propose a dynamic growth paradigm for the automatic curation of instruction-tuning data . they use existing datasets to automatically construct instruction-uning datasets . |
| Outcome: | The proposed model reduces the API cost for generating instructions and provides high-quality data. |
RECOST: External Knowledge Guided Data-efficient Instruction Tuning (2024.findings-acl)
Copied to clipboard
| Challenge: | Considering the high computing power overhead, data-efficient instruction tuning is proposed to reduce the training data size. |
| Approach: | They propose a framework to improve instruction tuning by integrating external knowledge into a single pipeline. |
| Outcome: | The proposed method achieves better results with only 1% of the full dataset. |
From English to Second Language Mastery: Enhancing LLMs with Cross-Lingual Continued Instruction Tuning (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) acquire strong language skills through extensive pre-training and supervised fine-tuning (SFT) on instructionresponse pairs. |
| Approach: | They propose a method which leverages translation-based parallel instruction data to enhance cross-lingual adaptability. |
| Outcome: | The proposed model improves on Llama-2-7B across five languages against three objective benchmarks and an LLM-as-a-judge benchmark. |