Challenge: Existing online backdoor defense methods for NLP models focus on anomalies at input or output level, causing fragility to adaptive attacks and high computational cost.
Approach: They propose a feature-based online defense method to detect poisoned samples . they use a distance-based anomaly score to distinguish poisones from clean samples based on feature-level regularization .
Outcome: The proposed method outperforms existing methods in sentiment analysis and offense detection tasks.

Similar Papers

Rethinking Stealthiness of Backdoor Attack against NLP Models (2021.acl-long)

Copied to clipboard

Challenge: Existing backdoor attacks are not stealthy to system deployers or users.
Approach: They propose a novel backdoor attack method based on negative data augmentation and modifying word embeddings that is much stealthier while maintaining pretty good attacking performance.
Outcome: The proposed method is much stealthier while maintaining pretty good attacking performance.
Triggerless Backdoor Attack for NLP Tasks with Clean Labels (2022.naacl-main)

Copied to clipboard

Challenge: Backdoor attacks are a new threat to neural natural language processing models due to the fragility and lack of interpretability of NLP models.
Approach: They propose a method to perform backdoor attacks without an external trigger . they propose to use clean-labeled examples to generate poisoned clean-labelled examples .
Outcome: The proposed strategy is effective and hard to defend due to its triggerless nature.
Backdoor NLP Models via AI-Generated Text (2024.lrec-main)

Copied to clipboard

Challenge: Existing attacks disregard fluency and semantic fidelity of poisoned text, rendering it easily detectable.
Approach: They propose to use AI-generated poisoned text to attack NLP models by establishing covert associations between trigger patterns and target labels without affecting normal accuracy.
Outcome: The proposed method achieves effective attacks while maintaining fluency and semantic similarity across all scenarios.
Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Models (2021.naacl-main)

Copied to clipboard

Challenge: Recent studies reveal a security threat to natural language processing models, called the Backdoor Attack.
Approach: They propose to hack a model by modifying one single word embedding vector without sacrificing accuracy on clean samples.
Outcome: The proposed method is more efficient and stealthier on sentiment analysis and sentence-pair classification tasks.
RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models (2021.emnlp-main)

Copied to clipboard

Challenge: Backdoor attacks are a serious threat to the safety of reusing deep neural networks (DNNs).
Approach: They propose an efficient online defense mechanism based on robustness-aware perturbations to distinguish poisoned and clean samples to defend against backdoor attacks on natural language processing models.
Outcome: The proposed method achieves better defending performance and lower computational costs than existing defense methods.
ONION: A Simple and Effective Defense Against Textual Backdoor Attacks (2021.emnlp-main)

Copied to clipboard

Challenge: Backdoor attacks can manipulate the output of deep neural networks and possess high insidiousness.
Approach: They propose a textual backdoor defense based on outlier word detection that can handle all the textual attacks.
Outcome: The proposed method can handle all the textual backdoor attack situations.
Large Language Models Are Better Adversaries: Exploring Generative Clean-Label Backdoor Attacks Against Text Classifiers (2023.findings-emnlp)

Copied to clipboard

Challenge: Backdoor attacks manipulate model predictions by inserting malicious "poison" instances that contain a specific pattern or "trigger."
Approach: They propose an attack that inserts style-based triggers into training and test data by using a poison selection technique to improve the effectiveness of both LLMBkd and existing backdoor attacks.
Outcome: The proposed attack achieves high success rates across a wide range of styles with little effort and no model training.
Where to Attack: A Dynamic Locator Model for Backdoor Attack in Text Classifications (2022.coling-1)

Copied to clipboard

Challenge: BackDoor Attack (BDA) study aims to train a poisoned model with clean data and some trigger-embedded instances to perform normally on normal inputs.
Approach: They propose to train a poisoned model with clean and poisonest inputs . they propose to use triggers to predict those poisonets as target labels .
Outcome: The proposed model can predict P2P dynamically without human intervention.
Textual Backdoor Attacks Can Be More Harmful via Two Simple Tricks (2022.emnlp-main)

Copied to clipboard

Challenge: Existing textual backdoor attacks are vulnerable to backdoors . researchers add extra training task to distinguish poisoned and clean data .
Approach: They propose two tricks that make existing backdoor attacks much more harmful . first trick is to add an extra task to distinguish poisoned and clean data . second trick is using all the clean training data rather than the original clean data.
Outcome: The proposed tricks can significantly improve attack performance in three tough situations including clean data fine-tuning, low-poisoning-rate, and label-consistent attacks.
BITE: Textual Backdoor Attacks with Iterative Trigger Injection (2023.acl-long)

Copied to clipboard

Challenge: Existing methods to defend against backdoor attacks are based on model stealing, model thieving and training data extraction attacks.
Approach: They propose a backdoor attack that poisons training data to establish strong correlations between the target label and a set of “trigger words” These trigger words are iteratively identified and injected into the target-label instances through natural word-level perturbations.
Outcome: The proposed attack is significantly more effective than baseline methods while maintaining decent stealthiness, raising alarm on the usage of untrusted training data.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations