Challenge: Adversarial examples can be used to trick machine learning models into making erroneous predictions, causing poorer insights and lower confidence in the information gathered.
Approach: They propose a textual adversarial example method that identifies falsely learned word indicators by leveraging explainable AI methods as importance functions on incorrectly predicted instances.
Outcome: The proposed method outperforms existing examples and training methods and shows baseline improvements of up to 23 percentage points on adversarial tasks.

Similar Papers

On the Transferability of Adversarial Attacks against Neural Text Classifier (2021.emnlp-main)

Copied to clipboard

Challenge: Existing studies show that deep neural networks are vulnerable to adversarial examples . a small perturbation to an input alters the model prediction .
Approach: They propose a genetic algorithm to find models that can induce adversarial examples to fool models . they propose word replacement rules that can be used for model diagnostics from these examples .
Outcome: The proposed model can fool almost all existing models, while ignoring the data bias in the training set.
Evaluating and Enhancing the Robustness of Neural Network-based Dependency Parsing Models with Adversarial Examples (2020.acl-main)

Copied to clipboard

Challenge: Previously studies focused on semantic tasks such as sentiment analysis, question answering and reading comprehension.
Approach: They propose two approaches to study where and how adversarial examples exist in dependency parsing . they use a state-of-the-art parser to find adversarials in existing texts .
Outcome: The proposed approaches show that adversarial examples exist in dependency parsing . they show that up to 77% of input examples admit adversarials .
A Closer Look into the Robustness of Neural Dependency Parsers Using Better Adversarial Examples (2021.findings-acl)

Copied to clipboard

Challenge: Neural network-based models have been successful in a wide range of NLP tasks, but their performance is undermined by adversarial examples that would pose no confusion for humans.
Approach: They propose a method to generate high-quality adversarial examples with a higher number of candidate generators and stricter filters and then verify their quality using automatic and human evaluations.
Outcome: The proposed method improves the robustness of English parsing models by relying on adversarial training and model ensembling.
A Reinforced Generation of Adversarial Examples for Neural Machine Translation (2020.acl-main)

Copied to clipboard

Challenge: Neural machine translation systems fail on less decent inputs, which may harm the credibility of these systems.
Approach: They propose a paradigm that generates adversarial examples using reinforcement learning to expose pitfalls for a given performance metric.
Outcome: The proposed paradigm produces stable attacks with meaning-preserving adversarial examples.
White-to-Black: Efficient Distillation of Black-Box Adversarial Attacks (N19-1)

Copied to clipboard

Challenge: Recent work in natural language processing generates adversarial examples using white-box access . a neural network can learn to emulate the behavior of a white- box attack and generalize well to new examples.
Approach: They propose an adversarial training approach that assumes white-box access to an attacker's model and optimizes the input directly against it.
Outcome: The proposed approach reduces example generation time by 19x-39x and exposes the Google Perspective API vulnerability.
On Adversarial Examples for Character-Level Neural Machine Translation (C18-1)

Copied to clipboard

Challenge: Using adversarial examples to measure robustness of deep learning models has become a standard procedure due to the difficulty of creating white-box adversarials for discrete text input.
Approach: They propose two novel attacks which aim to remove or change a word in a translation, rather than simply break the NMT.
Outcome: The proposed attacks are significantly stronger than their black-box counterparts in different attack scenarios, showing more serious vulnerabilities than previously known.
Robust Machine Comprehension Models via Adversarial Training (N18-2)

Copied to clipboard

Challenge: Existing models for the Stanford Question Answering Dataset suffer from a 50% decrease in F1 score during adversarial evaluation based on AddSent.
Approach: They propose an alternative adversary-generation algorithm, AddSentDiverse, that significantly increases the variance within the adversarial training data by providing effective examples that punish the model for making certain superficial assumptions.
Outcome: The proposed algorithm can achieve a 36.5% increase in F1 score while maintaining performance on the regular SQuAD task.
Plot-guided Adversarial Example Construction for Evaluating Open-domain Story Generation (2021.naacl-main)

Copied to clipboard

Challenge: Existing methods to generate implausible stories using plots are unnatural and oversimplify the characteristics of implusible machine-generated stories.
Approach: They propose to generate a more comprehensive set of implausible stories using plots . plots are structured representations of controllable factors used to generate stories .
Outcome: The proposed model improves the quality of generated implausible stories using plots . it shows that the evaluation metrics trained on the generated data correlate better with human judgments compared to baselines.
KNOW How to Make Up Your Mind! Adversarially Detecting and Alleviating Inconsistencies in Natural Language Explanations (2023.acl-short)

Copied to clipboard

Challenge: eIA is an adversarial attack that generates inconsistent natural language explanations (NLEs) a model that generate In-NLE is undesirable, as it has a faulty decision-making process or is prone to inconsistencies.
Approach: They propose an off-the-shelf mitigation method to alleviate inconsistencies by grounding the model into external background knowledge.
Outcome: The proposed method reduces inconsistencies detected by previous models . it is based on external knowledge bases and a novel approach to mitigate inconsistent models based upon the proposed method .
Detection of Adversarial Examples in Text Classification: Benchmark and Baseline via Robust Density Estimation (2022.findings-acl)

Copied to clipboard

Challenge: Word-level adversarial attacks have shown success in NLP, decreasing performance of transformer-based models with smaller perturbation rate.
Approach: They propose a dataset for four popular attack methods on four datasets and four models to encourage further research in this field.
Outcome: The proposed baseline has the highest auc on 29 out of 30 dataset-attack-model combinations.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations