Is Robustness Transferable across Languages in Multilingual Neural Machine Translation? (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have focused on bilingual machine translation with a single translation direction. |
| Approach: | They propose a robustness transfer analysis protocol to analyze the transferability of robustness across different languages in multilingual neural machine translation. |
| Outcome: | The proposed protocol shows that the robustness gained in one translation direction can transfer to other translation directions. |
Similar Papers
Did Translation Models Get More Robust Without Anyone Even Noticing? (2025.acl-long)
Copied to clipboard
| Challenge: | Neural machine translation models are highly sensitive to “noisy” inputs, such as spelling errors, abbreviations, and formatting issues. |
| Approach: | They revisit this insight in light of recent multilingual MT models and large language models applied to machine translation. |
| Outcome: | The proposed models perform better on clean data than previous models, but none of the open models use robustness techniques. |
An Empirical Study on the Robustness of Massively Multilingual Neural Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent years have witnessed that massively multilingual neural machine translation (MMNMT) achieves a remarkable progress in both high- and low-resource language translation. |
| Approach: | They propose to use a robustness evaluation benchmark dataset to assess the translation robustness of Indonesian-Chinese translation in the face of various naturally occurring noise. |
| Outcome: | The proposed dataset is publicly available at https://github.com/ID-ZH-MTRobustEval. |
Improving Neural Machine Translation Robustness via Data Augmentation: Beyond Back-Translation (D19-55)
Copied to clipboard
| Challenge: | Neural Machine Translation models are sensitive to noise in the input data. |
| Approach: | They propose new methods to extend limited noisy data and further improve NMT robustness to noise while keeping the models small. |
| Outcome: | The proposed methods extend limited noisy data and improve robustness to noise while keeping the models small. |
Multimodal Robustness for Neural Machine Translation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to deal with noisy multimodal inputs are not robust enough to deal effectively with noisy data. |
| Approach: | They propose a method that composes domain adapters to deal with noisy inputs . they combine these adapters at runtime via dynamic routing or when source of noise is unknown . |
| Outcome: | The proposed model is flexible and state-of-the-art to deal with noisy multimodal inputs. |
Visual Cues and Error Correction for Translation Robustness (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing robustness techniques fail when faced with unseen types of noise and their performance degrades on clean texts. |
| Approach: | They propose visual context to improve translation robustness for noisy texts . they also propose an error correction training regime that can be used as an auxiliary task . |
| Outcome: | The proposed training regime improves translation robustness on noisy texts while maintaining translation quality on clean texts. |
Can Large Language Models Learn Translation Robustness from Noisy-Source In-context Demonstrations? (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have been used for machine translation, but their robustness remains a challenge, as they struggle to translate sentences in the presence of noise even when using similarity-based in-context learning methods. |
| Approach: | They propose a scheme for studying machine translation robustness on LLMs by using noisy-source demonstration examples. |
| Outcome: | The proposed model can learn robustness from noisy-source demonstration examples, thereby improving translation performance on noisy sentences. |
Multilingual Neural Machine Translation (2020.coling-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we will cover the latest advances in NMT to enhance low-resource translation. |
| Approach: | They will cover the latest advances in NMT approaches that leverage multilingualism . they will focus on topics such as language divergence, transfer learning and pivoting . |
| Outcome: | This tutorial will cover the latest advances in NMT to enhance low-resource translation models. |
Evaluating Robustness to Input Perturbations for Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Recent work has shown that Neural Machine Translation models are brittle to small perturbations in the input. |
| Approach: | They propose to use subword regularization to measure the relative degradation and changes in translation when perturbations are added to the input. |
| Outcome: | The proposed measures show that the models are more robust to perturbations when subword regularization methods are used. |
To Translate or Not to Translate: A Systematic Investigation of Translation-Based Cross-Lingual Transfer to Low-Resource Languages (2024.naacl-long)
Copied to clipboard
| Challenge: | XLT with multilingual language models is superfluous, says a new study . mBERT, XLM-R and mT5 are effective for cross-lingual transfer, authors say . |
| Approach: | They propose to use multilingual language models to improve cross-lingual transfer (XLT) they propose to add reliable translations to training data for XLT even for non-MT languages . |
| Outcome: | The proposed approaches outperform zero-shot XLT with mLMs, the authors show . the authors believe their findings warrant a broader inclusion of more robust translation-based baselines in XL research. |
Towards Robust Neural Machine Translation (P18-1)
Copied to clipboard
| Challenge: | Small perturbations in the input can severely distort intermediate representations and thus impact translation quality of neural machine translation models. |
| Approach: | They propose adversarial stability training to make encoder and decoder robust to perturbations by enabling them to behave similarly for the original input and its perturbed counterpart. |
| Outcome: | The proposed approach improves translation quality and robustness over strong models on Chinese-English, English-German and English-French translation tasks. |