Challenge: Existing approaches to create adversarial examples using tokens are not sufficient to ensure other desirable properties such as similarity to non-adversarial examples, linguistic fluency, and so forth.
Approach: They propose a method which leverages a set of pretrained language models to promote similarity to non-adversarial examples, linguistic fluency, and so forth.
Outcome: The proposed approach outperforms existing methods and is competitive with token-based approaches.

Similar Papers

Improving Gradient-based Adversarial Training for Text Classification by Contrastive Learning and Auto-Encoder (2021.findings-acl)

Copied to clipboard

Challenge: Recent work has shown that models can be easily fooled by intentionally designed adversarial examples.
Approach: They propose two efficient approaches for generating adversarial perturbations on embeddings and propose two new approaches to help model learn adversarials more efficiently.
Outcome: The proposed approaches outperform strong baselines on various text classification datasets and the model's performance drops less under adversarial attack.
LexicalAT: Lexical-Based Adversarial Reinforcement Training for Robust Sentiment Classification (D19-1)

Copied to clipboard

Challenge: Existing text classification models are fragile and sensitive to simple perturbations.
Approach: They propose a generator-classifier adversarial training approach to improve classification models . they use a large-scale lexical knowledge base to generate attacking examples .
Outcome: The proposed approach outperforms strong baselines and reduces test errors on neural networks.
Multi-Adversarial Learning for Cross-Lingual Word Embeddings (2021.naacl-main)

Copied to clipboard

Challenge: Generative adversarial networks (GANs) have succeeded in inducing cross-lingual word embeddings without supervision, but their performance for distant languages is still not satisfactory.
Approach: They propose a multi-adversarial method that induces the seed cross-lingual dictionary through multiple mappings, each induced to fit the mapping for one subspace.
Outcome: The proposed method improves performance on bilingual lexicon induction and cross-lingual document classification on unsupervised bilingual linguistic induction.
Generative Adversarial Training with Perturbed Token Detection for Model Robustness (2023.emnlp-main)

Copied to clipboard

Challenge: Existing adversarial training methods use discrete tokens to deceive models . current approaches use embeddings, whereas actual text-based training uses discrete text tokens.
Approach: They propose a framework that integrates gradient-based learning, adversarial example generation and perturbed token detection to enhance adversariarial robustness.
Outcome: The proposed framework surpasses the state-of-the-art results of ChatGPT by 10% in average accuracy.
Adversarial Attack and Defense of Structured Prediction Models (2020.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to building effective adversarial attackers focus on classification problems.
Approach: They propose a framework that learns to attack a structured prediction model with feedbacks from multiple reference models.
Outcome: The proposed framework is able to attack state-of-the-art models and boost them with training . it is based on a sequence-to-sequence model with feedbacks from multiple reference models .
BERT-ATTACK: Adversarial Attack Against BERT Using BERT (2020.emnlp-main)

Copied to clipboard

Challenge: Current approaches to generate adversarial samples for discrete data are heuristic replacement strategies that are difficult to implement in continuous data.
Approach: They propose a method to generate adversarial samples using pre-trained masked language models using BERT.
Outcome: The proposed method outperforms state-of-the-art methods in success rate and perturb percentage while remaining fluent and semantically preserved.
Impact of Adversarial Training on Robustness and Generalizability of Language Models (2023.findings-acl)

Copied to clipboard

Challenge: Adversarial training is widely acknowledged as the most effective defense against adversarial attacks, but achieving both robustness and generalization requires a trade-off.
Approach: They propose to compare pre-training data augmentation and training time input perturbations with embedding space perturbations to find out whether they improve generalization.
Outcome: The proposed methods improve generalization and robustness of the trained models.
Data Augmentation with Adversarial Training for Cross-Lingual NLI (2021.acl-long)

Copied to clipboard

Challenge: Existing approaches to train cross-lingual models with labeled data are subpar, resulting in subpar results.
Approach: They propose a data augmentation strategy that enriches data to reflect more diversity in a semantically faithful way and leverages adversarial training regimens to achieve greater robustness.
Outcome: The proposed approach improves cross-lingual inference by leveraging the data to reflect more diversity in a semantically faithful way.
Towards Improving Adversarial Training of NLP Models (2021.findings-emnlp)

Copied to clipboard

Challenge: Recent methods for generating NLP adversarial examples involve combinatorial search and expensive sentence encoders for constraining the generated instances.
Approach: They propose to use vanilla adversarial training to train NLP models using a word substitution attack optimized for vanilla adversary training.
Outcome: The proposed approach improves model performance and standard accuracy and can defend against other types of word substitution attacks.
Adversarial Text Generation by Search and Learning (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing text generation methods only use heuristic replacement strategies or language models to generate replacement words at the word level.
Approach: They propose a search and learning framework for Adversarial Text Generation by Search and Learning to evaluate the robustness of natural language processing models.
Outcome: The proposed methods are significantly superior to the most advanced methods in terms of attack efficiency and adversarial text quality.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations