Robustness Evaluation of Text Classification Models Using Mathematical Optimization and Its Application to Adversarial Training (2022.findings-aacl)
Copied to clipboard
| Challenge: | Neural networks are vulnerable to adversarial examples due to slightly perturbed input data. |
| Approach: | They propose a method that evaluates the robustness of text classification models by an optimization problem that identifies a minimum synonym swap that changes the classification result. |
| Outcome: | The proposed method achieves high scores in human evaluations of grammatical correctness and semantic similarity for an IMDb dataset and implements adversarial training with the IMD and SST2 datasets. |
Similar Papers
Evaluating Neural Model Robustness for Machine Comprehension (2021.eacl-main)
Copied to clipboard
| Challenge: | evaluating model robustness to adversarial attacks can provide deeper understanding of how deep neural networks work and what kind of linguistic information is actually captured by neural networks. |
| Approach: | They propose a method for strategic sentence-level perturbations to evaluate model robustness to adversarial attacks using character and word perturbations. |
| Outcome: | The proposed model improves model performance during adversarial attacks by using ensembles and predicts errors in adversarials. |
Robustness and Adversarial Examples in Natural Language Processing (2021.emnlp-tutorials)
Copied to clipboard
| Challenge: | This tutorial aims to raise awareness of practical concerns about NLP robustness . it aims at addressing the weaknesses of NLP systems when faced with adversarial inputs and data with a distribution shift . |
| Approach: | This tutorial aims to bring awareness of practical concerns about NLP robustness . it reviews recent studies on analyzing the weakness of NLP systems when facing adversarial inputs . |
| Outcome: | This tutorial aims to bring awareness of practical concerns about NLP robustness . it will examine the weaknesses of NLP systems when faced with adversarial inputs and data with a distribution shift . |
Assessing Robustness of Text Classification through Maximal Safe Radius Computation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Neural network NLP models are vulnerable to small modifications of the input that maintain the original meaning but result in a different prediction. |
| Approach: | They propose to provide a measure of robustness against word substitutions by computing a safe radius for a given input text. |
| Outcome: | The proposed methods are compared with LIME and CNN-Cert and show that they perform well on sentiment analysis and news classification models. |
Achieving Verified Robustness to Symbol Substitutions via Interval Bound Propagation (D19-1)
Copied to clipboard
Po-Sen Huang, Robert Stanforth, Johannes Welbl, Chris Dyer, Dani Yogatama, Sven Gowal, Krishnamurthy Dvijotham, Pushmeet Kohli
| Challenge: | Recent work has exposed the vulnerabilities of neural NLP models, e.g. with small, semantically invariant input alterations. |
| Approach: | They propose to model text classification under synonym replacements or character flip perturbations and then use a formal model verification method to verify its robustness. |
| Outcome: | The proposed models show little difference in terms of nominal accuracy, but have much improved verified accuracy under perturbations and come with an efficiently computable formal guarantee on worst case adversaries. |
Searching for an Effective Defender: Benchmarking Defense against Adversarial Word Substitution (2021.emnlp-main)
Copied to clipboard
Zongyi Li, Jianhan Xu, Jiehang Zeng, Linyang Li, Xiaoqing Zheng, Qi Zhang, Kai-Wei Chang, Cho-Jui Hsieh
| Challenge: | Existing methods to defend against adversarial word-substitution attacks have not been evaluated or compared in a systematic manner. |
| Approach: | They propose to compare different defense methods under representative adversarial attacks . they propose a method that improves the robustness of neural text classifiers against such attacks a . |
| Outcome: | The proposed method improves robustness of neural text classifiers against such attacks by a significant margin. |
A Novel Metric for Measuring the Robustness of Large Language Models in Non-adversarial Scenarios (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Using large language models, we evaluated their robustness on multiple datasets. |
| Approach: | They propose a new metric for assessing model robustness by empirical evaluation of several models on multiple datasets. |
| Outcome: | The proposed metric is based on a set of datasets that are constructed by introducing naturally-occurring, non-malicious perturbations or by generating semantically equivalent paraphrases of input questions or statements. |
Interpreting the Robustness of Neural NLP Models to Textual Perturbations (2022.findings-acl)
Copied to clipboard
| Challenge: | Modern Natural Language Processing models are sensitive to input perturbations and their performance can decrease when applied to noisy data. |
| Approach: | They propose to explain the extent to which a model is affected by an unseen textual perturbation by the learnability of the perturbation. |
| Outcome: | The proposed model is better at identifying a perturbation (higher learnability) but worse at ignoring it (lower robustness). |
Balanced Adversarial Training: Balancing Tradeoffs between Fickleness and Obstinacy in NLP Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Traditional adversarial examples involve finding a small perturbation that does not change an input’s true label but confuses the classifier into outputting a different prediction. |
| Approach: | They propose to use contrastive learning to increase model robustness against fickle adversarial examples by reducing the vulnerability of adversarials to fickle ones. |
| Outcome: | The proposed method improves model robustness against fickle and obstinate adversarial examples. |
Evaluating and Enhancing the Robustness of Neural Network-based Dependency Parsing Models with Adversarial Examples (2020.acl-main)
Copied to clipboard
| Challenge: | Previously studies focused on semantic tasks such as sentiment analysis, question answering and reading comprehension. |
| Approach: | They propose two approaches to study where and how adversarial examples exist in dependency parsing . they use a state-of-the-art parser to find adversarials in existing texts . |
| Outcome: | The proposed approaches show that adversarial examples exist in dependency parsing . they show that up to 77% of input examples admit adversarials . |
On Robustness of Neural Semantic Parsers (2021.eacl-main)
Copied to clipboard
| Challenge: | Semantic parsing maps natural language (NL) utterances into logical forms (LFs) adversarial examples are created by adding tiny perturbations to inputs but can severely deteriorate model performance. |
| Approach: | They propose to construct robustness test sets based on existing benchmark corpora and to evaluate the effect of data augmentation. |
| Outcome: | The proposed method measures the performance of the proposed parsers on robustness test sets and evaluates the effect of data augmentation. |