| Challenge: | An effective method to improve neural machine translation with monolingual data is to augment the parallel training corpus with back-translations of target language sentences. |
| Approach: | They propose to augment parallel training corpus with back-translations of target language sentences to improve neural machine translation with monolingual data. |
| Outcome: | The proposed method achieves a state-of-the-art of 35 BLEU on the WMT’14 English-German test set. |
Similar Papers
Back-Translation Sampling by Targeting Difficult Words in Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) uses a sequence-to-sequence model to generate synthetic data. |
| Approach: | They propose a method that adds synthetic data to sentences with high prediction loss during training and a variety of sampling strategies targeting difficult-to-predict words. |
| Outcome: | The proposed method improves translation quality by up to 1.7 and 1.2 Bleu points over back-translation using random sampling for German-English and English-German, respectively. |
An Extensive Exploration of Back-Translation in 60 Languages (2023.findings-acl)
Copied to clipboard
| Challenge: | Back-translation has been shown to improve model quality through the creation of synthetic training bitext. |
| Approach: | They use back-translation to train models from 60 languages into English . early studies showed promise of the technique and follow on studies have produced refinements . |
| Outcome: | a new study shows that back-translation improves translation quality in low-resource languages . the results are consistent with previous studies, though there are limitations . |
Exploiting Monolingual Data at Scale for Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is a well-known and expensive task. |
| Approach: | They propose a method to use target-side monolingual data for neural machine translation and propose 'synthetic bitext' they propose generating synthetic bitext by translating monolingual into the other domain using models pretrained on genuine bitext. |
| Outcome: | The proposed approach achieves state-of-the-art results on WMT16, WMT17, WTM18 EnglishGerman translations and WTM19 GermanFrench translations. |
Back Translation for Speech-to-text Translation Without Transcripts (2023.acl-long)
Copied to clipboard
| Challenge: | End-to-end speech-totext translation (ST) is often achieved by utilizing source transcripts, but transcripts are only sometimes available since numerous unwritten languages exist worldwide. |
| Approach: | They propose an algorithm to synthesize pseudo ST data from monolingual target data to enhance ST without generating source transcripts. |
| Outcome: | The proposed method achieves an average boost of 2.3 BLEU on MuST-C En-De, En-Fr, and En-Es datasets. |
On The Evaluation of Machine Translation Systems Trained With Back-Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Back-translation is a data augmentation technique that can be used to improve neural machine translation systems. |
| Approach: | They propose to combine back-translation with a language model score to measure fluency. |
| Outcome: | The proposed method improves translation quality of natural text and translationese according to professional translators. |
Phrase-Based & Neural Unsupervised Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Recent advances in machine translation have reported near human-level performance on several languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences. |
| Approach: | They propose two models that leverage a careful initialization of the parameters and denoising effect of language models. |
| Outcome: | The proposed models outperform the current methods on English-French and German-English benchmarks while being simpler and having fewer hyper-parameters. |
On Synthetic Data for Back Translation (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing studies on back translation (BT) focus on beam search or random sampling . a new method to generate synthetic data with a backward model is proposed to improve BT performance. |
| Approach: | They propose a method to generate synthetic data to trade off quality and importance factors . back translation (BT) is one of the most significant technologies in NMT research fields . |
| Outcome: | The proposed method outperforms the baseline methods on WMT14 DE-EN, EN-DE, and RU-EN benchmark tasks. |
Leveraging Synthetic Targets for Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Using synthetic target data, training models on synthetic targets outperforms training on actual ground-truth data. |
| Approach: | They propose a recipe for training machine translation models on synthetic target data by leveraging a large pre-trained model. |
| Outcome: | The proposed model outperforms training on real-world translation datasets. |
Tagged Back-translation Revisited: Why Does It Really Work? (2020.acl-main)
Copied to clipboard
| Challenge: | In this paper, we show that neural machine translation systems trained on large back-translated data overfit some of the characteristics of machine-transcribed texts. |
| Approach: | They propose to add a tag to back-translations to help distinguish back-translated data from original parallel training data. |
| Outcome: | The proposed tag helps the system distinguish back-translated data from original parallel training data and is as effective as a tag in high-resource training. |
Selecting Backtranslated Data from Multiple Sources for Improved Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | incorporating backtranslated data from different sources has led to improved results in machine translation (MT) |
| Approach: | They use a low-resource use-case and a high-resourced language pair to test different backtranslation scenarios and employ data selection to optimise the synthetic corpora. |
| Outcome: | The proposed method reduces the amount of data used while maintaining high-quality MT systems. |