Challenge: Recent advances in Large Language Models have sparked concerns about their safety.
Approach: They propose a method to identify safety-related information in the model parameter space . they propose to use a few adversarially chosen examples to fine-tune LLMs .
Outcome: The proposed method can break safety alignment in multilingual LLMs using a few examples . it also shows that the proposed method jailbreaks LLM models adapted to new languages .

Similar Papers

The Language Barrier: Dissecting Safety Challenges of LLMs in Multilingual Contexts (2024.findings-acl)

Copied to clipboard

Challenge: Recent studies show that malicious prompt instructions could solicit objectionable content from LLMs.
Approach: They compare how state-of-the-art LLMs respond to malicious prompts in different languages . they find that LLM's generate unsafe responses more often when a prompt is written in a lower-resource language .
Outcome: The proposed model can generate unsafe responses more often when a malicious prompt is written in a lower-resource language, and less irrelevant responses when written in lower-source languages.
Multitask-Bench: Unveiling and Mitigating Safety Gaps in LLMs Fine-tuning (2025.coling-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have led to their adoption across a wide range of tasks, ranging from code generation to machine translation and sentiment analysis.
Approach: They propose to fine-tune LLMs on benign (non-harmful) data to ensure safe outputs.
Outcome: The proposed model reduces attack success rates across a range of tasks without compromising its usefulness.
When Safety Alignment Fails to Generalize: Probing with Language Game Jailbreaks (2026.findings-acl)

Copied to clipboard

Challenge: Existing safety alignment methods rely on fixed or narrow transformation schemes to generalize . existing methods based on fixed and narrow transformations are often inadequate .
Approach: They propose a framework for discovering and refining language game-based jailbreaks to probe alignment generalization.
Outcome: The proposed framework allows controlled exploration of alignment behavior across closely related linguistic variants.
Towards Identification and Intervention of Safety-Critical Parameters in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing safety-related methodologies for large language models are lacking . despite advances in safety alignment techniques, safeguarding LLMs during adaptation to various tasks remains a challenge.
Approach: They propose a framework to quantify how different parameters affect LLM safety . they propose two targeted intervention paradigms for safety enhancement and preservation .
Outcome: The proposed framework reveals safety-critical patterns across different LLM architectures.
All Languages Matter: On the Multilingual Safety of LLMs (2024.findings-acl)

Copied to clipboard

Challenge: Existing safety benchmarks only concern the safety in one language, e.g. the majority language in the pretraining data such as English.
Approach: They propose a prompting method to improve multilingual safety of ChatGPT by enhancing cross-lingual generalization of safety alignment.
Outcome: The proposed method can significantly reduce the ratio of unsafe responses by 42% for non-English queries.
On the Vulnerability of Safety Alignment in Open-Access LLMs (2024.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are susceptible to malicious exploitation, but are often rejected and limited harmfulness is limited.
Approach: They propose two types of reverse alignment techniques: reverse supervised fine-tuning (RSFT) and reverse preference optimization (RPO).
Outcome: The proposed methods can significantly enhance the success rate and harmfulness of jailbreak attacks, but they face high rejection rates and limited harmfulness.
SafeMERGE: Preserving Safety Alignment in Fine-Tuned Large Language Models via Selective Layer-Wise Model Merging (2026.findings-acl)

Copied to clipboard

Challenge: Recent studies show that fine-tuning can erode safety alignment, causing LLMs to respond to harmful or unethical prompts.
Approach: They propose a lightweight framework that restores safety while maintaining downstream performance.
Outcome: The proposed framework reduces harmful outputs compared to other defenses, with negligible impact on utility.
Safety of Large Language Models Beyond English: A Systematic Literature Review of Risks, Biases, and Safeguards (2026.eacl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have a growing number of applications that generate harmful, biased, or unsafe content.
Approach: They synthesize findings from recent studies that evaluate their robustness across languages . they highlight gaps in multilingual safety research and recommend future work .
Outcome: The systematic review examines the multilingual safety of large language models in English . it identifies challenges such as dataset availability and evaluation biases .
Safeguard Fine-Tuned LLMs Through Pre- and Post-Tuning Model Merging (2025.findings-emnlp)

Copied to clipboard

Challenge: Fine-tuning large language models for downstream tasks often leads to catastrophic forgetting, notably degrading the safety of original alignments.
Approach: They propose to merge the weights of pre- and post-fine-tuned models to improve safety while enhancing performance.
Outcome: Experiments across different downstream tasks and models validate the method’s practicality and effectiveness.
Separate the Wheat from the Chaff: A Post-Hoc Approach to Safety Re-Alignment for Fine-Tuned Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large language models achieve effective safety alignment at the time of release, but fine-tuning often compromises safety mechanisms.
Approach: They propose a method that performs safety realignment for large language models . they identify unsafe delta parameters from the fine-tuned models and recalibrate the retained parameters .
Outcome: The proposed method improves safety performance on safety benchmarks and jailbreak attacks while maintaining their performance on downstream tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations