Generating Authentic Adversarial Examples beyond Meaning-preserving with Doubly Round-trip Translation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to generate adversarial examples for NMT use the meaning-preserving restriction. |
| Approach: | They propose a new definition for adversarial examples based on the Doubly Round-Trip Translation (DRTT) they introduce masked language models to construct bilingual adversarials based upon DRTT . |
| Outcome: | The proposed approach significantly improves the robustness of the NMT model on clean and noisy test sets. |
Similar Papers
Crafting Adversarial Examples for Neural Machine Translation (2021.acl-long)
Copied to clipboard
| Challenge: | Effective adversary generation for neural machine translation is crucial for robust systems. |
| Approach: | They propose to leverage round-trip translation technique to build valid metrics for evaluating NMT adversarial attacks. |
| Outcome: | The proposed method could break the state-of-art NMT models with small perturbations. |
Robust Neural Machine Translation with Doubly Adversarial Inputs (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) models suffer from noisy perturbations in the input . a gradient-based method to craft adversarial examples informed by the translation loss is proposed . |
| Approach: | They propose an approach to improve the robustness of NMT models by attacking the translation model with adversarial source examples and defending the model with a target input. |
| Outcome: | The proposed approach improves translation performance and robustness on clean inputs and higher on noisy data. |
On Adversarial Examples for Character-Level Neural Machine Translation (C18-1)
Copied to clipboard
| Challenge: | Using adversarial examples to measure robustness of deep learning models has become a standard procedure due to the difficulty of creating white-box adversarials for discrete text input. |
| Approach: | They propose two novel attacks which aim to remove or change a word in a translation, rather than simply break the NMT. |
| Outcome: | The proposed attacks are significantly stronger than their black-box counterparts in different attack scenarios, showing more serious vulnerabilities than previously known. |
A Reinforced Generation of Adversarial Examples for Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Neural machine translation systems fail on less decent inputs, which may harm the credibility of these systems. |
| Approach: | They propose a paradigm that generates adversarial examples using reinforcement learning to expose pitfalls for a given performance metric. |
| Outcome: | The proposed paradigm produces stable attacks with meaning-preserving adversarial examples. |
Towards Robust Neural Machine Translation with Iterative Scheduled Data-Switch Training (2022.coling-1)
Copied to clipboard
Zhongjian Miao, Xiang Li, Liyan Kang, Wen Zhang, Chulun Zhou, Yidong Chen, Bin Wang, Min Zhang, Jinsong Su
| Challenge: | Existing methods on robust neural machine translation (NMT) construct adversarial examples by injecting noise into authentic examples and indiscriminately exploit two types of examples. |
| Approach: | They propose an iterative scheduled data-switch training framework to mitigate this problem by injecting noise into authentic examples and indiscriminately exploiting two types of examples. |
| Outcome: | The proposed model outperforms several competitive benchmarks on four translation benchmarks. |
Adversarially Improving NMT Robustness to ASR Errors with Confusion Sets (2022.aacl-short)
Copied to clipboard
| Challenge: | Existing methods for robustness against homophone errors are limited to homophones . substitution errors are the most common errors in NMT models . |
| Approach: | They propose an adversarial example generation method based on confusion sets that contain words easily confusable with a target word by ASR to conduct adversarially training for NMT models. |
| Outcome: | The proposed method improves on the clean test set and can be used in real-world scenarios. |
Rethinking Round-Trip Translation for Machine Translation Evaluation (2023.findings-acl)
Copied to clipboard
| Challenge: | Automatic evaluation methods for translation often require model training and the availability of parallel corpora limits their applicability to low-resource settings. |
| Approach: | They revisit the statistical machine translation technique and use it to improve translation quality. |
| Outcome: | The proposed method improves translation quality estimation models and identifies adversarial competitors in shared tasks via cross-system verification. |
AdvAug: Robust Adversarial Augmentation for Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Recent work in neural machine translation has led to dramatic improvements in both research and commercial systems. |
| Approach: | They propose a adversarial augmentation method for Neural Machine Translation that minimizes vicinal risk over virtual sentences . they use a novel vicinity distribution for adversarials to describe a smooth interpolated embedding space . |
| Outcome: | The proposed method outperforms the current method on Chinese-English, English-French, and English-German translation benchmarks. |
Exploiting Monolingual Data at Scale for Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is a well-known and expensive task. |
| Approach: | They propose a method to use target-side monolingual data for neural machine translation and propose 'synthetic bitext' they propose generating synthetic bitext by translating monolingual into the other domain using models pretrained on genuine bitext. |
| Outcome: | The proposed approach achieves state-of-the-art results on WMT16, WMT17, WTM18 EnglishGerman translations and WTM19 GermanFrench translations. |
Adversarial Subword Regularization for Robust Neural Machine Translation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for segmenting words into subword units are not robust enough to handle multiple subword candidates. |
| Approach: | They propose to regularize subword segmentations that maximize the translation loss by using gradient signals during training to prevent erroneous segmentations of unseen words. |
| Outcome: | The proposed method improves the performance of NMT models on low-resource and out-domain datasets. |