A Reinforced Generation of Adversarial Examples for Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Neural machine translation systems fail on less decent inputs, which may harm the credibility of these systems. |
| Approach: | They propose a paradigm that generates adversarial examples using reinforcement learning to expose pitfalls for a given performance metric. |
| Outcome: | The proposed paradigm produces stable attacks with meaning-preserving adversarial examples. |
Similar Papers
A Closer Look into the Robustness of Neural Dependency Parsers Using Better Adversarial Examples (2021.findings-acl)
Copied to clipboard
| Challenge: | Neural network-based models have been successful in a wide range of NLP tasks, but their performance is undermined by adversarial examples that would pose no confusion for humans. |
| Approach: | They propose a method to generate high-quality adversarial examples with a higher number of candidate generators and stricter filters and then verify their quality using automatic and human evaluations. |
| Outcome: | The proposed method improves the robustness of English parsing models by relying on adversarial training and model ensembling. |
ReinforceBug: A Framework to Generate Adversarial Textual Examples (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent studies have demonstrated that ML Models are sensitive to Adversarial Examples (AEs) AEs are generated by perturbingining examples that preserve the intrinsic utility of the ML solutions but influence the classifier's predictions between original and modified inputs. |
| Approach: | They propose a reinforcement learning framework that learns a policy that is transferable on unseen datasets and generates utility-preserving and transferable AEs. |
| Outcome: | The proposed framework is 10% more successful than the state-of-the-art attack TextFooler. |
Crafting Adversarial Examples for Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Effective adversary generation for neural machine translation is crucial for robust systems. |
| Approach: | They propose to leverage round-trip translation technique to build valid metrics for evaluating NMT adversarial attacks. |
| Outcome: | The proposed method could break the state-of-art NMT models with small perturbations. |
Evaluating and Enhancing the Robustness of Neural Network-based Dependency Parsing Models with Adversarial Examples (2020.acl-main)
Copied to clipboard
| Challenge: | Previously studies focused on semantic tasks such as sentiment analysis, question answering and reading comprehension. |
| Approach: | They propose two approaches to study where and how adversarial examples exist in dependency parsing . they use a state-of-the-art parser to find adversarials in existing texts . |
| Outcome: | The proposed approaches show that adversarial examples exist in dependency parsing . they show that up to 77% of input examples admit adversarials . |
PAEG: Phrase-level Adversarial Example Generation for Neural Machine Translation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for adversarial example generation are word-level or character-level, which ignore the ubiquitous phrase structure. |
| Approach: | They propose a phrase-level adversarial example generation framework to enhance the robustness of the translation model by adopting a sentence-level substitution strategy. |
| Outcome: | The proposed method improves translation performance and robustness to noise on three benchmarks. |
Attacking Visual Language Grounding with Adversarial Examples: A Case Study on Neural Image Captioning (P18-1)
Copied to clipboard
| Challenge: | Visual language grounding is widely studied in modern neural image captioning systems . a novel algorithm for crafting adversarial examples in image captions is proposed . |
| Approach: | They propose an algorithm to craft adversarial examples in machine vision and perception . their approach provides two evaluation approaches to check if they can mislead systems . |
| Outcome: | The proposed algorithm can craft visually-similar adversarial examples with randomly targeted captions or keywords, and the results are transferable to other image captioning systems. |
On the Transferability of Adversarial Attacks against Neural Text Classifier (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies show that deep neural networks are vulnerable to adversarial examples . a small perturbation to an input alters the model prediction . |
| Approach: | They propose a genetic algorithm to find models that can induce adversarial examples to fool models . they propose word replacement rules that can be used for model diagnostics from these examples . |
| Outcome: | The proposed model can fool almost all existing models, while ignoring the data bias in the training set. |
On Adversarial Examples for Character-Level Neural Machine Translation (C18-1)
Copied to clipboard
| Challenge: | Using adversarial examples to measure robustness of deep learning models has become a standard procedure due to the difficulty of creating white-box adversarials for discrete text input. |
| Approach: | They propose two novel attacks which aim to remove or change a word in a translation, rather than simply break the NMT. |
| Outcome: | The proposed attacks are significantly stronger than their black-box counterparts in different attack scenarios, showing more serious vulnerabilities than previously known. |
Identifying Human Strategies for Generating Word-Level Adversarial Examples (2022.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that word-level adversarial examples are more natural and grammatical correct than automated attacks. |
| Approach: | They analyze how humans generate word-level adversarial examples against fine-tuned Transformer models that preserve naturalness and grammatical correctness. |
| Outcome: | The authors show that humans generate adversarial examples much more effortlessly than automated attacks. |
Using Adversarial Examples in Natural Language Processing (L18-1)
Copied to clipboard
| Challenge: | Recent advances in machine learning have led to the use of adversarial examples in training of neural networks. |
| Approach: | They investigate the effect of using adversarial examples during training of recurrent neural networks whose text input is in the form of a sequence of word/character embeddings. |
| Outcome: | The proposed method provides regularization effect and enables training of models with greater number of parameters without overfitting. |