Papers by Ailin Tao
Intrinsic Model Weaknesses: How Priming Attacks Unveil Vulnerabilities in Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have significant impact on various industries and societal functions due to advanced instruction-following capabilities. |
| Approach: | They developed and tested novel attack strategies on popular LLMs to expose their vulnerabilities in generating harmful content. |
| Outcome: | The proposed attacks achieved an ASR of 100% on open-source models, including Meta’s Llama-3.2, Google’s Gemma-2, Mistral’s Mistral-NeMo, Falcon’s Falcon-mamba, Apple’s DCLM, Microsoft’s Phi3, and Qwen’s Qwend2.5, among others. |
Path Drift in Large Reasoning Models: How First-Person Commitments Override Safety (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on prompt injection and jailbreak attacks primarily target the surface structure of input prompts. |
| Approach: | They propose a three-stage approach to mitigate the risk of Long-CoT reasoning drift . they propose 'path-level defense' strategy that incorporates role attribution correction and metacognitive reflection . |
| Outcome: | The proposed framework reduces refusal rates and ethical evaporation, while ethical escalation and layered disclaimers progressively steer models toward unsafe completions. |