Word-level Textual Adversarial Attacking as Combinatorial Optimization (2020.acl-main)
Copied to clipboard
| Challenge: | Existing word-level attack models are far from perfect because of unsuitable search space reduction methods and inefficient optimization algorithms. |
| Approach: | They propose a novel adversarial adversarialist model that incorporates word substitution and particle swarm optimization to solve two problems separately. |
| Outcome: | The proposed model achieves much higher success rates and crafts more high-quality adversarial examples as compared to baseline methods. |
Similar Papers
BERT-ATTACK: Adversarial Attack Against BERT Using BERT (2020.emnlp-main)
Copied to clipboard
| Challenge: | Current approaches to generate adversarial samples for discrete data are heuristic replacement strategies that are difficult to implement in continuous data. |
| Approach: | They propose a method to generate adversarial samples using pre-trained masked language models using BERT. |
| Outcome: | The proposed method outperforms state-of-the-art methods in success rate and perturb percentage while remaining fluent and semantically preserved. |
Rethinking Word-level Adversarial Attack: The Trade-off between Efficiency, Effectiveness, and Imperceptibility (2024.lrec-main)
Copied to clipboard
| Challenge: | Neural language models have demonstrated impressive performance but remain vulnerable to word-level adversarial attacks. |
| Approach: | They propose two standardized search spaces to address the problem of word-level adversarial attacks. |
| Outcome: | The proposed search spaces improve performance and trade-offs in different scenarios. |
Towards Improving Adversarial Training of NLP Models (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Recent methods for generating NLP adversarial examples involve combinatorial search and expensive sentence encoders for constraining the generated instances. |
| Approach: | They propose to use vanilla adversarial training to train NLP models using a word substitution attack optimized for vanilla adversary training. |
| Outcome: | The proposed approach improves model performance and standard accuracy and can defend against other types of word substitution attacks. |
BERT-Defense: A Probabilistic Model Based on BERT to Combat Cognitively Inspired Orthographic Adversarial Attacks (2021.findings-acl)
Copied to clipboard
| Challenge: | adversarial attacks expose important blind spots of deep learning systems, authors show . word and sentence-level attacks tend to be more difficult to defend via spelling correction modules . character-level attack scenarios often involve finding semantic paraphrases of input . |
| Approach: | They propose a model that probabilistically combines context-independent word level information with context-dependent information from BERT's masked language modeling to combat low-level orthographic attacks. |
| Outcome: | The proposed model outperforms a spellchecker and Pruthi's model on a character-level benchmark. |
Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitution (2021.emnlp-main)
Copied to clipboard
Zongyi Li, Jianhan Xu, Jiehang Zeng, Linyang Li, Xiaoqing Zheng, Qi Zhang, Kai-Wei Chang, Cho-Jui Hsieh
| Challenge: | Existing methods to defend against adversarial word-substitution attacks have not been evaluated or compared in a systematic manner. |
| Approach: | They propose to compare different defense methods under representative adversarial attacks . they propose a method that improves the robustness of neural text classifiers against such attacks a . |
| Outcome: | The proposed method improves robustness of neural text classifiers against such attacks by a significant margin. |
Self-Supervised Contrastive Learning with Adversarial Perturbations for Defending Word Substitution-based Attacks (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to improve model robustness against word substitution-based adversarial attacks are too slow to generate adversarials on the fly. |
| Approach: | They propose an approach to improve the robustness of BERT models against word substitution-based adversarial attacks by leveraging adversarials for self-supervised contrastive learning. |
| Outcome: | The proposed method improves robustness of BERT models against word substitution-based adversarial attacks without using any labeled data. |
Evaluating the Validity of Word-level Adversarial Attacks with Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing adversarial examples can generate invalid adversarials due to significant changes in semantic meanings compared to their originals. |
| Approach: | They propose to use a large language model to evaluate adversarial examples by semantic constraints. |
| Outcome: | The proposed method can generate valid adversarial examples even when they are not equipped with semantic constraints. |
TextAttack: A Framework for Adversarial Attacks, Data Augmentation, and Adversarial Training in NLP (2020.emnlp-demos)
Copied to clipboard
| Challenge: | TextAttack provides implementations of 16 adversarial attacks from the literature and supports a variety of models and datasets. |
| Approach: | They introduce a Python framework for adversarial attacks, data augmentation, and adversarially training in NLP. |
| Outcome: | This paper introduces a Python framework for adversarial attacks, data augmentation, and adversarially training in NLP. |
Arabic Synonym BERT-based Adversarial Examples for Text Classification (2024.eacl-srw)
Copied to clipboard
| Challenge: | Often, research studies quantifying the impact of adversarial text attacks have been applied only to models trained in English. |
| Approach: | They propose a word-level study of adversarial text examples in Arabic . they use a synonym attack with a BERT model to assess their robustness . |
| Outcome: | The proposed attack compares Arabic adversarial examples with their original examples and regains 2% accuracy after training. |
From Hero to Zéroe: A Benchmark of Low-Level Adversarial Attacks (2020.aacl-main)
Copied to clipboard
| Challenge: | Adversarial attacks are label-preserving modifications to inputs of machine learning classifiers designed to fool machines but not humans. |
| Approach: | They propose to use a dataset to test the robustness of future NLP models to identify low-level adversarial attacks that are less realistic in typical applications such as social media. |
| Outcome: | The proposed dataset provides a benchmark for testing robustness of future more human-like NLP models. |