Evaluating the Validity of Word-level Adversarial Attacks with Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing adversarial examples can generate invalid adversarials due to significant changes in semantic meanings compared to their originals. |
| Approach: | They propose to use a large language model to evaluate adversarial examples by semantic constraints. |
| Outcome: | The proposed method can generate valid adversarial examples even when they are not equipped with semantic constraints. |
Similar Papers
Reevaluating Adversarial Examples in Natural Language (2020.findings-emnlp)
Copied to clipboard
| Challenge: | State-of-the-art adversarial examples lack a common definition of what constitutes success . human surveys show that to preserve semantics, we need to increase the minimum cosine similarities between the embeddings of swapped words and between the sentence encodings of original and perturbed sentences. |
| Approach: | They propose a unified definition of what constitutes a successful adversarial example . they propose four categories of constraints that are used to define adversarials . |
| Outcome: | The proposed framework is based on the outputs of two state-of-the-art synonym substitution attacks. |
Contrasting Human- and Machine-Generated Word-Level Adversarial Examples for Text Classification (2021.emnlp-main)
Copied to clipboard
| Challenge: | Recent work has raised the question of whether valid adversarial inputs are feasible. |
| Approach: | They analyze how human-generated adversarial examples compare to the best algorithms . they use crowdsourcing to modify words in an input text with immediate feedback . |
| Outcome: | The proposed algorithms are not more efficient than the best to generate natural-reading, sentiment-preserving examples. |
Close or Cloze? Assessing the Robustness of Large Language Models to Adversarial Perturbations via Word Recovery (2025.coling-main)
Copied to clipboard
| Challenge: | Existing models implicitly recover the original text, but it is unclear when they rely on context and when they implicitly do so. |
| Approach: | They propose to use a dictionary to recover adversarial words by using a phonetic, typo, and visual attack to study word recovery performance. |
| Outcome: | The proposed model outperforms open-source models on hateful, offensive, and toxic classification tasks. |
How do humans perceive adversarial text? A reality check on the validity and naturalness of word-based adversarial attacks (2023.acl-long)
Copied to clipboard
| Challenge: | Existing text adversarial attacks are impractical in real-world scenarios where humans are involved. |
| Approach: | They have surveyed 378 human participants about the perceptibility of text adversarial examples produced by state-of-the-art methods. |
| Outcome: | The proposed methods ignore the property of imperceptibility or study it under limited conditions. |
Attacking Misinformation Detection Using Adversarial Examples Generated by Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models can be used to attack content filtering algorithms in social media platforms. |
| Approach: | They propose to generate adversarial examples to test the robustness of social media content filtering algorithms. |
| Outcome: | The proposed model outperforms existing models in the case of propaganda, false claims, rumours and hyperpartisan news. |
A Closer Look into the Robustness of Neural Dependency Parsers Using Better Adversarial Examples (2021.findings-acl)
Copied to clipboard
| Challenge: | Neural network-based models have been successful in a wide range of NLP tasks, but their performance is undermined by adversarial examples that would pose no confusion for humans. |
| Approach: | They propose a method to generate high-quality adversarial examples with a higher number of candidate generators and stricter filters and then verify their quality using automatic and human evaluations. |
| Outcome: | The proposed method improves the robustness of English parsing models by relying on adversarial training and model ensembling. |
Vulnerabilities of Large Language Models to Adversarial Attacks (2024.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial focuses on the vulnerabilities of Large Language Models to adversarial attacks . the tutorial lays the foundation by explaining safety-aligned models and concepts in cybersecurity . |
| Approach: | This tutorial lays the foundation by explaining safety-aligned LLMs and concepts in cybersecurity. |
| Outcome: | The tutorial lays the foundation by explaining safety-aligned models and concepts in cybersecurity. |
Tougher Text, Smarter Models: Raising the Bar for Adversarial Defence Benchmarks (2025.coling-main)
Copied to clipboard
| Challenge: | Recent advances in natural language processing have highlighted the vulnerability of deep learning models to adversarial attacks. |
| Approach: | They propose a benchmark for textual adversarial defence that evaluates state-of-the-art defence mechanisms across diverse datasets, models, and tasks. |
| Outcome: | The proposed benchmark incorporates a wide range of datasets and evaluates state-of-the-art defence mechanisms. |
Generating Natural Language Adversarial Examples (D18-1)
Copied to clipboard
| Challenge: | Recent research has shown that deep neural networks are vulnerable to adversarial examples, perturbations to correctly classified examples which can cause the model to misclassify. |
| Approach: | They propose to generate adversarial examples that fool well-trained sentiment analysis and textual entailment models by using a black-box population-based optimization algorithm. |
| Outcome: | The proposed model is able to fool well-trained sentiment analysis and textual entailment models with success rates of 97% and 70%, respectively. |
Identifying Human Strategies for Generating Word-Level Adversarial Examples (2022.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that word-level adversarial examples are more natural and grammatical correct than automated attacks. |
| Approach: | They analyze how humans generate word-level adversarial examples against fine-tuned Transformer models that preserve naturalness and grammatical correctness. |
| Outcome: | The authors show that humans generate adversarial examples much more effortlessly than automated attacks. |