Extract and Edit: An Alternative to Back-Translation for Unsupervised Neural Machine Translation (N19-1)
Copied to clipboard
| Challenge: | Back-translation has been used in previous approaches for unsupervised neural machine translation, but pseudo sentences are of low quality as translation errors accumulate during training. |
| Approach: | They propose an approach to extract and edit real sentences from monolingual corpora and introduce a comparative translation loss to evaluate the translated target sentences. |
| Outcome: | The proposed approach outperforms state-of-the-art translation systems across two benchmarks and two low-resource language pairs by more than 2 BLEU points. |
Similar Papers
Unsupervised Extraction of Partial Translations for Neural Machine Translation (N19-1)
Copied to clipboard
| Challenge: | Neural machine translation systems usually require a large quantity of bilingual parallel data for training. |
| Approach: | They propose an algorithm for extracting from monolingual data what they call partial translations . partial translation is a pair of source and target sentences that contain sequences of tokens that are translations of each other. |
| Outcome: | The proposed algorithm extracts from monolingual data what we call partial translations . it takes only source and target monolingual datasets as input . |
Phrase-Based & Neural Unsupervised Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Recent advances in machine translation have reported near human-level performance on several languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences. |
| Approach: | They propose two models that leverage a careful initialization of the parameters and denoising effect of language models. |
| Outcome: | The proposed models outperform the current methods on English-French and German-English benchmarks while being simpler and having fewer hyper-parameters. |
Improving Machine Translation with Phrase Pair Injection and Corpus Filtering (2022.emnlp-main)
Copied to clipboard
| Challenge: | In this paper, we show that the combination of Phrase Pair Injection and Corpus Filtering boosts the performance of Neural Machine Translation systems. |
| Approach: | They propose to combine Phrase Pair Injection and Corpus Filtering to boost performance of Neural Machine Translation systems. |
| Outcome: | The proposed method improves machine translation models on low-resource language pairs . BLEU score improves over models trained with whole pseudo-parallel corpus augmented with parallel corpus. |
Multilingual Unsupervised Neural Machine Translation with Denoising Adapters (2021.emnlp-main)
Copied to clipboard
| Challenge: | Multilingual unsupervised machine translation is a computationally expensive and hard to tune approach . auxiliary parallel data is used to train translation systems from monolingual data . |
| Approach: | They propose to use auxiliary parallel language pairs to train unsupervised machine translations . they propose to add auxiliary languages to pre-trained mBART-50 models with denoising adapters . |
| Outcome: | The proposed approach is on-par with back-translation and allows adding unseen languages incrementally. |
Filtering Back-Translated Data in Unsupervised Neural Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Current state of the art approaches for unsupervised neural machine translation (NMT) use only monolingual data for training. |
| Approach: | They propose an approach to filter back-translated data as part of the training process of unsupervised neural machine translation (NMT) they propose a weight component based on the quality of pseudo parallel sentence pairs generated in back-translation phase. |
| Outcome: | The proposed approach improves the training performance of unsupervised neural machine translation systems by giving weight to good pseudo parallel sentence pairs in the back-translation phase. |
An Effective Approach to Unsupervised Machine Translation (P19-1)
Copied to clipboard
| Challenge: | a recent research line has managed to train both unsupervised and unsupervised machine translation systems using monolingual corpora only. |
| Approach: | They propose to use monolingual corpora to train both unsupervised and unsupervised machine translation systems. |
| Outcome: | The proposed system achieves 22.5 BLEU points in English-to-German WMT 2014, 5.5 points more than the previous best unsupervised system, and 0.5 points more in the (supervised) shared task winner back in 2014. |
Extracting Parallel Sentences with Bidirectional Recurrent Neural Networks to Improve Machine Translation (C18-1)
Copied to clipboard
| Challenge: | Parallel sentence extraction is a task addressing the data sparsity problem found in multilingual natural language processing applications. |
| Approach: | They propose a bidirectional recurrent neural network based approach to extract parallel sentences from multilingual corpora. |
| Outcome: | The proposed approach outperforms existing approaches on noisy parallel corpora and shows significant improvements in translation performance. |
Back-Translation Sampling by Targeting Difficult Words in Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) uses a sequence-to-sequence model to generate synthetic data. |
| Approach: | They propose a method that adds synthetic data to sentences with high prediction loss during training and a variety of sampling strategies targeting difficult-to-predict words. |
| Outcome: | The proposed method improves translation quality by up to 1.7 and 1.2 Bleu points over back-translation using random sampling for German-English and English-German, respectively. |
Tagged Back-translation Revisited: Why Does It Really Work? (2020.acl-main)
Copied to clipboard
| Challenge: | In this paper, we show that neural machine translation systems trained on large back-translated data overfit some of the characteristics of machine-transcribed texts. |
| Approach: | They propose to add a tag to back-translations to help distinguish back-translated data from original parallel training data. |
| Outcome: | The proposed tag helps the system distinguish back-translated data from original parallel training data and is as effective as a tag in high-resource training. |
Understanding Back-Translation at Scale (D18-1)
Copied to clipboard
| Challenge: | An effective method to improve neural machine translation with monolingual data is to augment the parallel training corpus with back-translations of target language sentences. |
| Approach: | They propose to augment parallel training corpus with back-translations of target language sentences to improve neural machine translation with monolingual data. |
| Outcome: | The proposed method achieves a state-of-the-art of 35 BLEU on the WMT’14 English-German test set. |