Challenge: Existing approaches to attack pre-trained language models suffer from low success rates or fail to search efficiently in the exponentially large perturbation space.
Approach: They propose an efficient framework to generate natural adversarial text by constructing different semantic perturbation functions.
Outcome: The proposed framework generates natural adversarial texts for different languages with high success rates.

Similar Papers

Universal Adversarial Attacks with Natural Triggers for Text Classification (2021.naacl-main)

Copied to clipboard

Challenge: Recent work has demonstrated the vulnerability of modern text classifiers to universal adversarial attacks, which are input-agnostic sequences of words added to text processed by classifier.
Approach: They propose a gradient-based search that aims to maximize the downstream classifier’s prediction loss by using an adversarially regularized autoencoder to generate triggers and propose heuristics to spot such attacks.
Outcome: The proposed algorithms reduce model accuracy while being less identifiable than prior models as per automatic detection metrics and human-subject studies.
TABS: Efficient Textual Adversarial Attack for Pre-trained NL Code Model Using Semantic Beam Search (2022.emnlp-main)

Copied to clipboard

Challenge: Existing black-box adversarial attacks on pre-trained models generate adversarials with greedy search.
Approach: They propose an efficient beam search black-box adversarial attack method . they use contextual semantic filtering to effectively reduce the search space .
Outcome: The proposed method shows good performance in terms of attack success rate, number of queries, and semantic similarity for two tasks: NL code search classification and retrieval tasks.
Word-level Textual Adversarial Attacking as Combinatorial Optimization (2020.acl-main)

Copied to clipboard

Challenge: Existing word-level attack models are far from perfect because of unsuitable search space reduction methods and inefficient optimization algorithms.
Approach: They propose a novel adversarial adversarialist model that incorporates word substitution and particle swarm optimization to solve two problems separately.
Outcome: The proposed model achieves much higher success rates and crafts more high-quality adversarial examples as compared to baseline methods.
Tougher Text, Smarter Models: Raising the Bar for Adversarial Defence Benchmarks (2025.coling-main)

Copied to clipboard

Challenge: Recent advances in natural language processing have highlighted the vulnerability of deep learning models to adversarial attacks.
Approach: They propose a benchmark for textual adversarial defence that evaluates state-of-the-art defence mechanisms across diverse datasets, models, and tasks.
Outcome: The proposed benchmark incorporates a wide range of datasets and evaluates state-of-the-art defence mechanisms.
Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attack (2024.lrec-main)

Copied to clipboard

Challenge: Despite the development of large language models, there are still significant challenges in detecting whether text is generated by a machine.
Approach: They propose a framework for a broader class of adversarial attacks to perform minor perturbations in machine-generated content to evade detection.
Outcome: The proposed framework can be compromised in as little as 10 seconds, and improves over iterative adversarial learning.
Semantic-Preserving Adversarial Code Comprehension (2022.coling-1)

Copied to clipboard

Challenge: Existing studies on improving PrLMs for source code comprehension have not found a way to improve both sides of the trade-off between the two aspects.
Approach: They propose to use semantic-preserving code embeddings to find worst-case attacks while forcing the model to predict the correct labels under these worst cases.
Outcome: The proposed model can stay robust against state-of-the-art attacks while boosting the performance of PrLMs for code.
Perturbations in the Wild: Leveraging Human-Written Text Perturbations for Realistic Adversarial Attack and Defense (2022.findings-acl)

Copied to clipboard

Challenge: ANTHRO extracts over 600K human-written text perturbations and leverages them for realistic adversarial attacks.
Approach: They propose an adversarial text manipulation algorithm that inductively extracts over 600K human-written text perturbations and leverages them for realistic adversarials.
Outcome: The proposed algorithm outperforms the TextBugger baseline with an increase of 50% and 40% in terms of semantic preservation and stealthiness when evaluated by layperson and professional human workers.
Generating Textual Adversaries with Minimal Perturbation (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing word-level adversarial approaches for textual data have various limitations due to the large search space consisting of combinations of candidate words.
Approach: They propose a novel attack strategy to find adversarial texts with high similarity to original texts without perturbation.
Outcome: The proposed approach achieves higher success rates and lower perturbation rates in four benchmark datasets compared with state-of-the-art approaches.
T3: Tree-Autoencoder Constrained Adversarial Text Generation for Targeted Attack (2020.emnlp-main)

Copied to clipboard

Challenge: Existing adversarial examples can induce arbitrary errors to the target models, but they can be exploited to estimate robustness of NLP models.
Approach: They propose a target-controllable adversarial attack framework T3 to handle adversarials . they use tree-based decoders to regularize the syntactic correctness of generated text .
Outcome: The proposed framework can be used to estimate the robustness of NLP models.
SemRoDe: Macro Adversarial Training to Learn Representations that are Robust to Word-Level Attacks (2024.naacl-long)

Copied to clipboard

Challenge: Existing approaches to defend against word-level attacks have been limited.
Approach: They propose a new approach called Semantic Robust Defence to enhance the robustness of language models by aligning the domains with a distance-based objective.
Outcome: The proposed approach can be generalized across word embeddings, even when they share minimal overlap at both vocabulary and word-substitution levels.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations