Self-Training for Unsupervised Neural Machine Translation in Unbalanced Training Data Scenarios (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods that use monolingual corpora for translation are not suitable for low-resource languages such as Estonian. |
| Approach: | They propose unsupervised neural machine translation (UNMT) that relies on monolingual corpora to train a robust UNMT system and improve its performance. |
| Outcome: | The proposed methods outperform conventional UNMT systems on several language pairs. |
Similar Papers
Robust Unsupervised Neural Machine Translation with Adversarial Denoising Training (2020.coling-main)
Copied to clipboard
| Challenge: | Unsupervised neural machine translation (UNMT) has attracted great interest in the machine translation community. |
| Approach: | They propose to explicitly take noisy data into consideration to improve the robustness of UNMT based systems. |
| Outcome: | The proposed methods significantly improved the robustness of the conventional UNMT systems in noisy scenarios. |
Improving Unsupervised Neural Machine Translation via Training Data Self-Correction (2024.lrec-main)
Copied to clipboard
| Challenge: | Unsupervised neural machine translation models can generate mistakes during training . however, the quality of pseudo-parallel sentences cannot be guaranteed . |
| Approach: | They propose a method to improve the quality of pseudo-parallel sentences . they use token-level translations to correct mis-translated tokens . |
| Outcome: | Empirical results show that the proposed method outperforms baselines on widely used datasets. |
Advances and Challenges in Unsupervised Neural Machine Translation (2021.eacl-tutorials)
Copied to clipboard
| Challenge: | Unsupervised neural machine translation (UNMT) has achieved impressive results, but there are still several challenges for the technology. |
| Approach: | They present a framework for unsupervised neural machine translation (UNMT) they examine the latest progress and challenges of UNMT and examine how it holds up . |
| Outcome: | The proposed method has achieved impressive results but still faces challenges. |
Unsupervised Neural Machine Translation for Low-Resource Domains via Meta-Learning (2021.acl-long)
Copied to clipboard
| Challenge: | Unsupervised machine translation suffers from data-scarce domains, authors report . a meta-learning algorithm trains the model to adapt to another domain by utilizing only a small amount of training data. |
| Approach: | They propose a meta-learning algorithm that trains the model to adapt to another domain . their model surpasses a transfer learning-based approach by up to 2-3 BLEU scores . |
| Outcome: | The proposed algorithm outperforms a transfer learning-based approach by 2-3 BLEU scores . the proposed model outperformed previous models in the domain of unsupervised machine translation . |
Bridging the Data Gap between Training and Inference for Unsupervised Neural Machine Translation (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that backtranslation improves UNMT performance by reducing the data gap between training and inference. |
| Approach: | They propose an online method to remedy the source discrepancy between training and inference . they use pseudo parallel data with translated source and translated target to mimic inference scenario . |
| Outcome: | The proposed method outperforms baselines on several widely-used language pairs by remedying the style and content gaps. |
An Effective Approach to Unsupervised Machine Translation (P19-1)
Copied to clipboard
| Challenge: | a recent research line has managed to train both unsupervised and unsupervised machine translation systems using monolingual corpora only. |
| Approach: | They propose to use monolingual corpora to train both unsupervised and unsupervised machine translation systems. |
| Outcome: | The proposed system achieves 22.5 BLEU points in English-to-German WMT 2014, 5.5 points more than the previous best unsupervised system, and 0.5 points more in the (supervised) shared task winner back in 2014. |
Reusing a Pretrained Language Model on Languages with Limited Corpora for Unsupervised NMT (2020.emnlp-main)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) models with limited data are ineffective when the two languages are not available for one language. |
| Approach: | They propose an approach that reuses a language model that is pretrained on two languages with large monolingual data to initialize an unsupervised neural machine translation system. |
| Outcome: | The proposed method outperforms a competitive cross-lingual pretraining model in English-Macedonian (En-Mk) and English-Albanian (En Sq) it yields more than +8.3 BLEU points for all four translation directions. |
Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Translation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for unsupervised neural machine translation (UNMT) use cross-lingual pretraining to align the lexical- and high-level representations of two languages. |
| Approach: | They propose to use type-level cross-lingual subword embeddings to enhance the bilingual masked language model pretraining with lexical-level information to align the two languages. |
| Outcome: | Empirical results show that the method improves on UNMT (up to 4.5 BLEU) and bilingual lexicon induction compared to baseline models. |
Unsupervised Bilingual Word Embedding Agreement for Unsupervised Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Unsupervised bilingual word embedding (UBWE) has helped unsupervised neural machine translation (UNMT) achieve remarkable results in several language pairs. |
| Approach: | They propose two methods that train UNMT with UBWE agreement . they propose to use UBwe to initialize word embedding in UNMT . |
| Outcome: | The proposed methods outperform conventional methods on several language pairs. |
Improving Non-autoregressive Neural Machine Translation with Monolingual Data (2020.acl-main)
Copied to clipboard
| Challenge: | Neural machine translation is usually done via knowledge distillation from an autoregressive (AR) model. |
| Approach: | They leverage large monolingual corpora to improve the NAR model's performance by transferring the autoregressive model' s generalization ability while preventing overfitting. |
| Outcome: | The proposed methods on the WMT14 En-De and WMT16 En-Ro news translation tasks show that monolingual data augmentation improves the NAR model to approach the teacher AR model’s performance. |