Robust Neural Machine Translation with Joint Textual and Phonetic Embedding (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation models are sensitive to noises in input sentences . one special kind of noise is the homophone noise, where words are replaced by other words with similar pronunciations. |
| Approach: | They propose to embed phonetic and textual information into neural machine translation datasets to improve robustness to homophone noises. |
| Outcome: | The proposed method improves the robustness of neural machine translation to homophone noises on clean test sets. |
Similar Papers
Improving Neural Machine Translation Robustness via Data Augmentation: Beyond Back-Translation (D19-55)
Copied to clipboard
| Challenge: | Neural Machine Translation models are sensitive to noise in the input data. |
| Approach: | They propose new methods to extend limited noisy data and further improve NMT robustness to noise while keeping the models small. |
| Outcome: | The proposed methods extend limited noisy data and improve robustness to noise while keeping the models small. |
Neural Machine Translation of Text from Non-Native Speakers (N19-1)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) systems are known to degrade when confronted with noisy data. |
| Approach: | They propose to augment training data with sentences containing artificially-introduced grammatical errors to make the system more robust to such errors. |
| Outcome: | The proposed approach recovers 1.0 BLEU out of 2.4 BLUE lost due to grammatical errors on a set of Spanish translations of the JFLEG grammar error correction corpus. |
Towards Robust Neural Machine Translation (P18-1)
Copied to clipboard
| Challenge: | Small perturbations in the input can severely distort intermediate representations and thus impact translation quality of neural machine translation models. |
| Approach: | They propose adversarial stability training to make encoder and decoder robust to perturbations by enabling them to behave similarly for the original input and its perturbed counterpart. |
| Outcome: | The proposed approach improves translation quality and robustness over strong models on Chinese-English, English-German and English-French translation tasks. |
Robust Neural Machine Translation with Doubly Adversarial Inputs (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) models suffer from noisy perturbations in the input . a gradient-based method to craft adversarial examples informed by the translation loss is proposed . |
| Approach: | They propose an approach to improve the robustness of NMT models by attacking the translation model with adversarial source examples and defending the model with a target input. |
| Outcome: | The proposed approach improves translation performance and robustness on clean inputs and higher on noisy data. |
PheMT: A Phenomenon-wise Dataset for Machine Translation Robustness on User-Generated Contents (2020.coling-main)
Copied to clipboard
| Challenge: | Existing studies suggest that Neural Machine Translation still struggles with certain kinds of input with considerable noise, such as User-Generated Contents (UGC) on the Internet. |
| Approach: | They propose to evaluate the robustness of Neural Machine Translation models against specific linguistic phenomena in Japanese-English translation. |
| Outcome: | The proposed model can handle user-generated content (UGC) on the Internet, but it is difficult to translate clean inputs. |
Addressing the Vulnerability of NMT in Input Perturbations (2021.naacl-industry)
Copied to clipboard
| Challenge: | Recent advances in NMT have improved translation quality but are vulnerable to input perturbations. |
| Approach: | They propose a method to reduce the effect of noisy inputs by using a Context-Enhanced Reconstruction approach. |
| Outcome: | The proposed approach improves robustness on Chinese-English and French-English translation tasks. |
Robust Neural Machine Translation for Abugidas by Glyph Perturbation (2024.eacl-short)
Copied to clipboard
| Challenge: | Neural machine translation systems are vulnerable when trained on limited data. |
| Approach: | They propose to add noise to the training phase to increase robustness of NMT systems trained on limited data. |
| Outcome: | The proposed training strategy overcomes noise and improves robustness for low-resource tasks for abugida glyphs. |
Improving Low-Resource NMT through Relevance Based Linguistic Features Incorporation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing studies on incorporating arbitrary syntactic information into neural machine translation (NMT) are lacking. |
| Approach: | They propose to integrate linguistic knowledge at different levels into neural machine translation framework to improve translation quality for language pairs with extremely limited data. |
| Outcome: | The proposed methods improve translation quality for all tasks by 3.09 BLEU points . the proposed methods are based on two different approaches . |
Better Neural Machine Translation by Extracting Linguistic Information from BERT (2021.eacl-main)
Copied to clipboard
| Challenge: | Experimental results show that incorporating linguistic information into neural machine translation models is no more difficult to train than conventional Transformer-based NMT. |
| Approach: | They propose to extract linguistic information from contextual word embeddings instead of point estimates to augment NMT models. |
| Outcome: | The proposed method generalizes better in a variety of training contexts and is no more difficult to train than conventional Transformer-based NMT. |
Shared-Private Bilingual Word Embeddings for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Word embedding is central to neural machine translation, but indirectly interfaces with other layers, making them comparatively isolated. |
| Approach: | They propose a shared-private bilingual word embedding which gives a closer relationship between the source and target embedders and reduces the number of model parameters. |
| Outcome: | The proposed model improves on 5 language pairs belonging to 6 different language families and written in 5 different alphabets and significantly reduces model parameters. |