Challenge: Existing methods to jailbreak Large Vision Language Models do not consider interaction between images and text.
Approach: They propose a prior-guided bimodal interactive black-box jailbreak attack for toxicity maximization that exploits the interaction of images and text.
Outcome: The proposed method outperforms state-of-the-art jailbreak methods in black box scenarios and in closed-source LVLMs.

Similar Papers

Crafting Adversarial Inputs for Large Vision-Language Models Using Black-Box Optimization (2026.findings-eacl)

Copied to clipboard

Challenge: Existing white-box jailbreak methods require full model accessibility and require computational costs.
Approach: They propose a black-box jailbreak attack using Zeroth-Order optimization using ZO-SPSA.
Outcome: The proposed method achieves highest jailbreak success rate on three LVLMs, including InstructBLIP, LLaVA and MiniGPT-4.
ReCon: Active Defense against Large Vision-Language Model Jailbreaks via Reverse Safety Concept Injection (2026.findings-acl)

Copied to clipboard

Challenge: Existing defense strategies neglect visual threats and lack of fine-grained specificity regarding specific attack semantics.
Approach: They propose a black-box defense framework that maps unsafe concepts to fine-grained, constructive Safe Concepts.
Outcome: a new black-box defense framework enhances robustness against jailbreak attacks . it maps detected unsafe concepts to fine-grained, constructive Safe Concepts . the proposed framework is available for free at http://www.epa.org/recon/ .
Distract Large Language Models for Automatic Jailbreak Attack (2024.emnlp-main)

Copied to clipboard

Challenge: Commercial large language models (LLMs) have made great progress in various NLP tasks.
Approach: They propose a black-box jailbreak framework for automated red teaming of Large language models using an iterative optimization algorithm to conceal malicious content and memory reframing.
Outcome: The proposed framework outperforms existing jailbreak defense methods and highlights the need to develop more effective and practical defense strategies.
Stand on The Shoulders of Giants: Building JailExpert from Previous Attack Experience (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods to generate human-aligned content with a “jailbreak prompt” are inefficient and repetitive, causing inefficiency and a lack of experience.
Approach: They propose a framework that integrates past attack experiences to aid current jailbreak attempts.
Outcome: The proposed framework improves both attack effectiveness and efficiency compared to the current black-box jailbreak method.
Exploring Jailbreak Attacks on LLMs through Intent Concealment and Diversion (2025.findings-acl)

Copied to clipboard

Challenge: Existing jailbreak methods face an excessive number of iterative queries and poor generalization across models.
Approach: They propose a jailbreak method that employs **I**ntent **C**oncealment and div**E**rsion to circumvent security constraints.
Outcome: The proposed method outperforms existing jailbreak techniques in question-answering and text-generation tasks.
Reference Attack: A New Cross-Modal Jailbreaking Attack against Multimodal Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have raised significant safety concerns about generated content, drawing attention from both academia and industry.
Approach: They propose a reference-guided cross-modal jailbreak method that enhances existing prompt-to-image injection attacks by exploiting MLLMs’ semantic reconstruction capabilities.
Outcome: The proposed method achieves an attack success rate of over 93% on leading MLLMs including ChatGPT, Gemini, Claude, and the widely used open-source LLaMA model.
Experience-Driven Multi-Agent Optimization for Black-Box Jailbreak Attacks on Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for jailbreak have poor transferability and high sensitivity to preprocessing . EMJO provides an effective and scalable paradigm for systematic jailbreak optimization .
Approach: They propose a model that couples agents into a closed-loop "probe–evaluate–revise” process . they propose EMJO, which can be query-efficient and transferable, under black-box access.
Outcome: a new approach outperforms existing jailbreak baselines on diverse LLMs . it achieves up to 11% improvement in attack success rate while reducing query cost .
ImgTrojan: Jailbreaking Vision-Language Models with ONE Image (2025.naacl-long)

Copied to clipboard

Challenge: Existing studies on the safety of large language models (LLMs) with human values have focused on the integration of multi-modal user input into these models.
Approach: They propose a method to bypass safety constraints of large language models by using poisoned images instead of original textual captions.
Outcome: The proposed attack bypasses safety constraints of large language models (VLMs) by replacing the original textual captions with malicious jailbreak prompts.
BitBypass: A New Direction in Jailbreaking Aligned Large Language Models with Bitstream Camouflage (2026.findings-eacl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have inherent risk of generating harmful and unsafe content.
Approach: They develop a black-box jailbreak attack that leverages hyphen-separated bitstream camouflage to bypass aligned Large Language Models' safety alignment.
Outcome: The proposed attack outperforms state-of-the-art jailbreak attacks in stealthiness and attack success.
Visual Contextual Attack: Jailbreaking MLLMs with Image-Driven Context Injection (2025.emnlp-main)

Copied to clipboard

Challenge: Recent studies have shown that visual encoders can induce harmful behavior in multimodal large language models.
Approach: They propose a vision-centric jailbreak attack that uses visual information to create a jailbreak context.
Outcome: The proposed attack outperforms baseline attacks on MM-SafetyBench and GPT-4o.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations