Papers by Ashish Hooda
PRP: Propagating Universal Perturbations to Attack Large Language Model Guard-Rails (2024.acl-long)
Copied to clipboard
Neal Mangaokar, Ashish Hooda, Jihye Choi, Shreyas Chandrashekaran, Kassem Fawaz, Somesh Jha, Atul Prakash
| Challenge: | Recent work has shown that large language models are susceptible to automated jailbreak attacks that induce them to generate harmful content. |
| Approach: | They propose a two-step attack strategy that leverages a universal adversarial prefix for the Guard Model and propagates this prefix to the response. |
| Outcome: | The proposed attack strategy is successful against several open-source and closed-source implementations of Guard Models. |