| Challenge: | Existing approaches to generate semantic collisions for NLP tasks are vulnerable to adversarial examples. |
| Approach: | They propose gradient-based approaches for generating semantic collisions given white-box access to a model and deploy them against several NLP tasks. |
| Outcome: | The proposed approaches evade perplexity-based filtering and discuss other potential mitigations. |
Similar Papers
Reevaluating Adversarial Examples in Natural Language (2020.findings-emnlp)
Copied to clipboard
| Challenge: | State-of-the-art adversarial examples lack a common definition of what constitutes success . human surveys show that to preserve semantics, we need to increase the minimum cosine similarities between the embeddings of swapped words and between the sentence encodings of original and perturbed sentences. |
| Approach: | They propose a unified definition of what constitutes a successful adversarial example . they propose four categories of constraints that are used to define adversarials . |
| Outcome: | The proposed framework is based on the outputs of two state-of-the-art synonym substitution attacks. |
BERT-ATTACK: Adversarial Attack Against BERT Using BERT (2020.emnlp-main)
Copied to clipboard
| Challenge: | Current approaches to generate adversarial samples for discrete data are heuristic replacement strategies that are difficult to implement in continuous data. |
| Approach: | They propose a method to generate adversarial samples using pre-trained masked language models using BERT. |
| Outcome: | The proposed method outperforms state-of-the-art methods in success rate and perturb percentage while remaining fluent and semantically preserved. |
Universal Adversarial Attacks with Natural Triggers for Text Classification (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent work has demonstrated the vulnerability of modern text classifiers to universal adversarial attacks, which are input-agnostic sequences of words added to text processed by classifier. |
| Approach: | They propose a gradient-based search that aims to maximize the downstream classifier’s prediction loss by using an adversarially regularized autoencoder to generate triggers and propose heuristics to spot such attacks. |
| Outcome: | The proposed algorithms reduce model accuracy while being less identifiable than prior models as per automatic detection metrics and human-subject studies. |
Generating Textual Adversaries with Minimal Perturbation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing word-level adversarial approaches for textual data have various limitations due to the large search space consisting of combinations of candidate words. |
| Approach: | They propose a novel attack strategy to find adversarial texts with high similarity to original texts without perturbation. |
| Outcome: | The proposed approach achieves higher success rates and lower perturbation rates in four benchmark datasets compared with state-of-the-art approaches. |
BAE: BERT-based Adversarial Examples for Text Classification (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have exposed the vulnerability of text classification models to adversarial examples . perturbed versions of the original text are indiscernible by humans and misclassified by the model . |
| Approach: | They propose a black box attack for generating adversarial examples using contextual perturbations from a BERT-masked language model. |
| Outcome: | The proposed attack produces examples with improved grammaticality and semantic coherence compared to previous work. |
SemAttack: Natural Textual Attacks via Different Semantic Spaces (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to attack pre-trained language models suffer from low success rates or fail to search efficiently in the exponentially large perturbation space. |
| Approach: | They propose an efficient framework to generate natural adversarial text by constructing different semantic perturbation functions. |
| Outcome: | The proposed framework generates natural adversarial texts for different languages with high success rates. |
Robustness and Adversarial Examples in Natural Language Processing (2021.emnlp-tutorials)
Copied to clipboard
| Challenge: | This tutorial aims to raise awareness of practical concerns about NLP robustness . it aims at addressing the weaknesses of NLP systems when faced with adversarial inputs and data with a distribution shift . |
| Approach: | This tutorial aims to bring awareness of practical concerns about NLP robustness . it reviews recent studies on analyzing the weakness of NLP systems when facing adversarial inputs . |
| Outcome: | This tutorial aims to bring awareness of practical concerns about NLP robustness . it will examine the weaknesses of NLP systems when faced with adversarial inputs and data with a distribution shift . |
Evaluating the Validity of Word-level Adversarial Attacks with Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing adversarial examples can generate invalid adversarials due to significant changes in semantic meanings compared to their originals. |
| Approach: | They propose to use a large language model to evaluate adversarial examples by semantic constraints. |
| Outcome: | The proposed method can generate valid adversarial examples even when they are not equipped with semantic constraints. |
Word-level Textual Adversarial Attacking as Combinatorial Optimization (2020.acl-main)
Copied to clipboard
| Challenge: | Existing word-level attack models are far from perfect because of unsuitable search space reduction methods and inefficient optimization algorithms. |
| Approach: | They propose a novel adversarial adversarialist model that incorporates word substitution and particle swarm optimization to solve two problems separately. |
| Outcome: | The proposed model achieves much higher success rates and crafts more high-quality adversarial examples as compared to baseline methods. |
The Interplay between Metaphors and NLP (2026.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial will provide an overview of the metaphor processing field. |
| Approach: | This tutorial will provide an overview of the metaphor processing field . it will focus on recent directions opened by LLMs for metaphor interpretation . |
| Outcome: | The tutorial will discuss the influence of various metaphor theories on the creation of annotated resources and models. |