Challenge: Recent studies show that neural natural language processing models are vulnerable to backdoor attacks.
Approach: They propose to inject neural models with backdoors activated by word substitution . their results raise a serious alarm to the security of NLP models, they argue .
Outcome: The proposed backdoors are activated by a learnable combination of word substitution and exhibit higher invisibility than previous methods.

Similar Papers

Rethinking Stealthiness of Backdoor Attack against NLP Models (2021.acl-long)

Copied to clipboard

Challenge: Existing backdoor attacks are not stealthy to system deployers or users.
Approach: They propose a novel backdoor attack method based on negative data augmentation and modifying word embeddings that is much stealthier while maintaining pretty good attacking performance.
Outcome: The proposed method is much stealthier while maintaining pretty good attacking performance.
Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger (2021.acl-long)

Copied to clipboard

Challenge: Existing methods for textual backdoor attacks insert additional contents into normal samples as triggers, causing detection and blocking of backdoors.
Approach: They propose to use syntactic structure as trigger in textual backdoor attacks . they propose to achieve similar attack performance but have higher invisibility .
Outcome: The proposed method achieves almost 100% success rate but has higher invisibility and stronger resistance to defenses than the insertion-based methods.
Triggerless Backdoor Attack for NLP Tasks with Clean Labels (2022.naacl-main)

Copied to clipboard

Challenge: Backdoor attacks are a new threat to neural natural language processing models due to the fragility and lack of interpretability of NLP models.
Approach: They propose a method to perform backdoor attacks without an external trigger . they propose to use clean-labeled examples to generate poisoned clean-labelled examples .
Outcome: The proposed strategy is effective and hard to defend due to its triggerless nature.
Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Models (2021.naacl-main)

Copied to clipboard

Challenge: Recent studies reveal a security threat to natural language processing models, called the Backdoor Attack.
Approach: They propose to hack a model by modifying one single word embedding vector without sacrificing accuracy on clean samples.
Outcome: The proposed method is more efficient and stealthier on sentiment analysis and sentence-pair classification tasks.
Here’s a Free Lunch: Sanitizing Backdoored Models with Model Merge (2024.findings-acl)

Copied to clipboard

Challenge: democratization of pre-trained language models brings significant security risks, including backdoor attacks.
Approach: They propose to merge a backdoored model with other homogeneous models to remediate backdoor vulnerabilities.
Outcome: The proposed model merging approach outperforms other models on classification tasks without additional resources or specific knowledge.
Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer (2021.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that popular NLP models are vulnerable to both adversarial and backdoor attacks based on text style transfer.
Approach: They propose to conduct adversarial and backdoor attacks based on text style transfer . the authors propose to use text style to alter the style of a sentence .
Outcome: The proposed methods show that popular models are vulnerable to both attacks based on text style transfer . the results show that the proposed methods perform better than baselines in many aspects .
Expose Backdoors on the Way: A Feature-Based Efficient Defense against Textual Backdoor Attacks (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing online backdoor defense methods for NLP models focus on anomalies at input or output level, causing fragility to adaptive attacks and high computational cost.
Approach: They propose a feature-based online defense method to detect poisoned samples . they use a distance-based anomaly score to distinguish poisones from clean samples based on feature-level regularization .
Outcome: The proposed method outperforms existing methods in sentiment analysis and offense detection tasks.
Security Challenges in Natural Language Processing Models (2023.emnlp-tutorial)

Copied to clipboard

Challenge: Large-scale natural language processing models are vulnerable to security issues, such as backdoor attacks, private data leakage, and imitation attacks.
Approach: They will dive into three emerging security issues in NLP research, i.e., backdoor attacks, private data leakage, and imitation attacks.
Outcome: This tutorial will cover three emerging security issues in NLP research, i.e., backdoor attacks, private data leakage, and imitation attacks.
MEGen: Generative Backdoor into Large Language Models via Model Editing (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for training large language models are limited to yes-or-no discriminative tasks, leading users to underestimate the potential risks.
Approach: They propose an editing-based generative backdoor that expands the backdoor to generative tasks in a unified format of any text-to-any text.
Outcome: The proposed model achieves high attack success rate by adjusting only a small set of local parameters with few-shot samples.
Backdoor NLP Models via AI-Generated Text (2024.lrec-main)

Copied to clipboard

Challenge: Existing attacks disregard fluency and semantic fidelity of poisoned text, rendering it easily detectable.
Approach: They propose to use AI-generated poisoned text to attack NLP models by establishing covert associations between trigger patterns and target labels without affecting normal accuracy.
Outcome: The proposed method achieves effective attacks while maintaining fluency and semantic similarity across all scenarios.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations