| Challenge: | Several datasets have been constructed to expose brittleness in models trained on existing benchmarks. |
| Approach: | They propose to use a challenge dataset to examine model adaptations by exposing models to a metaphorical pathogen and assessing how well they can adapt. |
| Outcome: | The proposed method analyzes the NLI stress tests and the Adversarial SQuAD datasets and shows that they are no longer challenging and others remain difficult. |
Similar Papers
On the Importance of Data Size in Probing Fine-tuned Models (2022.findings-acl)
Copied to clipboard
| Challenge: | Several studies have investigated the reasons behind the effectiveness of fine-tuning, usually through the lens of probing. |
| Approach: | They propose to investigate the reasons behind the effectiveness of fine-tuning by examining the impact of data size on the extent of encoded linguistic knowledge. |
| Outcome: | The proposed probes show that the size of the training data affects the recoverability of the changes made to the model’s linguistic knowledge. |
Immunization against harmful fine-tuning attacks (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models are often trained with safety guards to prevent harmful text generation. |
| Approach: | They propose a formal framework based on the training budget of an attacker to validate defenses against harmful fine-tuning attacks. |
| Outcome: | The proposed framework validates whether a model has been fine-tuned against harmful fine-uning attacks on harmful datasets. |
Take the essence and discard the dross: A Rethinking on Data Selection for Fine-Tuning Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies focus on data selection but lack a clear, unified framework . variability in experimental settings complicates systematic comparisons . |
| Approach: | They propose a three-stage scheme to standardize data selection for fine-tuning large language models . they propose unified comparison approach that incorporates ratio-based efficiency and ranking-based feasibility metrics to address inconsistencies across experiments. |
| Outcome: | The proposed scheme outperforms existing methods in a dozen key studies and identifies key challenges. |
Predicting Fine-Tuning Performance with Probing (2022.emnlp-main)
Copied to clipboard
| Challenge: | Large-scale neural models have recently demonstrated impressive performance in language understanding tasks, typically evaluated by their fine-tuned performance. |
| Approach: | They propose to use probing to extract a proxy signal widely used in model development to predict fine-tuning performance. |
| Outcome: | The proposed method predicts fine-tuning performance with errors 40% - 80% smaller than baselines. |
Multitask-Bench: Unveiling and Mitigating Safety Gaps in LLMs Fine-tuning (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have led to their adoption across a wide range of tasks, ranging from code generation to machine translation and sentiment analysis. |
| Approach: | They propose to fine-tune LLMs on benign (non-harmful) data to ensure safe outputs. |
| Outcome: | The proposed model reduces attack success rates across a range of tasks without compromising its usefulness. |
Improving the OOD Performance of Closed-Source LLMs on NLI Through Strategic Data Selection (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to improve robustness require changing the fine-tuning process or large-scale data augmentation, which are infeasible or cost prohibitive for closed-source models. |
| Approach: | They propose to prioritize more complex examples or replace existing training examples with LLM-generated data to improve performance on OOD NLI datasets. |
| Outcome: | The proposed methods improve performance on difficult OOD datasets while training with synthetic data leads to substantial improvements on easier OOD data. |
Dissecting Fine-Tuning Unlearning in Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning-based unlearning are ineffective at completely erasing model-embedded knowledge, but their true effectiveness remains unclear. |
| Approach: | They propose to use activation patching and parameter restoration experiments to examine the limitations of fine-tuning-based unlearning methods for erasing harmful, sensitive, or copyrighted information within large language models. |
| Outcome: | The proposed methods alter the model’s knowledge retrieval process rather than genuinely erasing the problematic knowledge embedded in the model parameters. |
Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) encapsulate a vast amount of factual information within their pre-trained weights. |
| Approach: | They compare unsupervised fine-tuning and retrieval-augmented generation approaches to learning new factual information. |
| Outcome: | The proposed models outperform unsupervised fine-tuning and retrieval-augmented generation (RAG) on knowledge-intensive tasks across different topics. |
SimSCOOD: Systematic Analysis of Out-of-Distribution Generalization in Fine-tuned Source Code Models (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large datasets are increasingly available for pre-training source code models, but obtaining representative training data that fully covers the code distribution for specific downstream tasks remains challenging due to the task-specific nature and limited labeling resources. |
| Approach: | They propose a systematic approach that simulates various OOD scenarios along different dimensions of source code data properties and investigates model behavior under different fine-tuning methodologies. |
| Outcome: | The proposed approach simulates various OOD scenarios along different dimensions of source code data properties and exposes multiple failure modes attributed to OOD generalization issues. |
Not All Parameters Are Created Equal: Smart Isolation Boosts Fine-Tuning Performance (2025.emnlp-main)
Copied to clipboard
| Challenge: | Extensive experiments demonstrate that our approach significantly alleviates task interference and forgetting. |
| Approach: | They propose a framework for supervised fine-tuning for large language models . they first fine-tail the model on each task to identify its core parameter regions . |
| Outcome: | The proposed framework outperforms vanilla fine-tuning and baselines on multiple public benchmarks on reasoning, dialogue, instruction following, and more. |