Challenge: open-weight large language models increase vulnerability to malicious fine-tuning . despite these advantages, open-source LLMs increase the potential for misuse .
Approach: They propose a safety guide for open-weight large language models that guides fine-tuning toward the safety manifold to preserve alignment.
Outcome: The proposed safety guidance trigger significantly improves robustness against malicious fine-tuning.

Similar Papers

On the Vulnerability of Safety Alignment in Open-Access LLMs (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are susceptible to malicious exploitation, but are often rejected and limited harmfulness is limited.
Approach: They propose two types of reverse alignment techniques: reverse supervised fine-tuning (RSFT) and reverse preference optimization (RPO).
Outcome: The proposed methods can significantly enhance the success rate and harmfulness of jailbreak attacks, but they face high rejection rates and limited harmfulness.
Towards Understanding the Fragility of Multilingual LLMs against Fine-Tuning Attacks (2025.findings-naacl)

Copied to clipboard

Challenge: Recent advances in Large Language Models have sparked concerns about their safety.
Approach: They propose a method to identify safety-related information in the model parameter space . they propose to use a few adversarially chosen examples to fine-tune LLMs .
Outcome: The proposed method can break safety alignment in multilingual LLMs using a few examples . it also shows that the proposed method jailbreaks LLM models adapted to new languages .
SafeMERGE: Preserving Safety Alignment in Fine-Tuned Large Language Models via Selective Layer-Wise Model Merging (2026.findings-acl)

Copied to clipboard

Challenge: Recent studies show that fine-tuning can erode safety alignment, causing LLMs to respond to harmful or unethical prompts.
Approach: They propose a lightweight framework that restores safety while maintaining downstream performance.
Outcome: The proposed framework reduces harmful outputs compared to other defenses, with negligible impact on utility.
Multitask-Bench: Unveiling and Mitigating Safety Gaps in LLMs Fine-tuning (2025.coling-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have led to their adoption across a wide range of tasks, ranging from code generation to machine translation and sentiment analysis.
Approach: They propose to fine-tune LLMs on benign (non-harmful) data to ensure safe outputs.
Outcome: The proposed model reduces attack success rates across a range of tasks without compromising its usefulness.
SDD: Self-Degraded Defense against Malicious Fine-tuning (2025.acl-long)

Copied to clipboard

Challenge: Open-source Large Language Models (LLMs) employ safety alignment methods to resist harmful instructions, but malicious fine-tuning can easily bypass these safeguards.
Approach: They propose a framework to prevent malicious fine-tuning of large language models on harmful data by using alignment methods that encourage them to produce irrelevant responses to harmful prompts.
Outcome: The proposed framework reduces the general capability of the LLM when malicious fine-tuning fails, rendering it incapable of following harmful instructions.
Defenses Against Prompt Attacks Learn Surface Heuristics (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are increasingly deployed in security-sensitive applications . recent defenses rely on supervised fine-tuning with benign and malicious labels . position bias arises when benign content placed later in a prompt is rejected at much higher rates .
Approach: They analyze three recurring shortcut behaviors induced by supervised fine-tuning . position bias arises when benign content placed later in a prompt is rejected . token trigger bias occurs when strings common in attack data raise rejection probability .
Outcome: The proposed model overrides intended logic when adversarial instructions appear . the proposed model has low rejection rates but narrow correlations in defense data .
The Art of (Mis)alignment: How Fine-Tuning Methods Effectively Misalign and Realign LLMs in Post-Training (2026.findings-acl)

Copied to clipboard

Challenge: Misaligned large language models can magnify harm by exploiting them to undermine safety . et al., 2022b; Bai e.t., 2023): misalignment, realignment and model-specific resistance are important .
Approach: They evaluate four methods to identify a mechanism asymmetry between attack and defense . they find that ORPO is most effective for misalignment, but DPO excels in realignment .
Outcome: The proposed methods show a mechanism asymmetry between attack and defense . the proposed methods excel in realignment, but at the expense of model utility .
Safety is Not Only About Refusal: Reasoning-Enhanced Fine-tuning for Interpretable LLM Safety (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are vulnerable to jailbreak attacks that exploit weaknesses in traditional safety alignment.
Approach: They propose a framework that trains models to engage in explicit safe reasoning before response . they propose RATIONAL, which allows models to reject harmful prompts while providing meaningful and context-aware responses.
Outcome: The proposed framework fine-tunes models to reason about query intent, ethics, and potential harm.
Separate the Wheat from the Chaff: A Post-Hoc Approach to Safety Re-Alignment for Fine-Tuned Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large language models achieve effective safety alignment at the time of release, but fine-tuning often compromises safety mechanisms.
Approach: They propose a method that performs safety realignment for large language models . they identify unsafe delta parameters from the fine-tuned models and recalibrate the retained parameters .
Outcome: The proposed method improves safety performance on safety benchmarks and jailbreak attacks while maintaining their performance on downstream tasks.
Safeguarding LLM Fine-tuning via Push-Pull Distributional Alignment (2026.acl-long)

Copied to clipboard

Challenge: Existing safety defenses for large language models fail to explicitly repel harmful patterns . Optimal transport (SOT) allows for safe fine-tuning without sacrificing safety .
Approach: They propose a framework that reframes safe fine-tuning from instance-level filtering challenge to distribution-level alignment task grounded in Optimal Transport.
Outcome: a new framework improves safety of large language models while maintaining competitive performance . the proposed framework reduces the risk of errors and improves model performance compared to baselines .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations