| Challenge: | Existing approaches to adapt neural machine translation systems to low-resource languages are difficult to implement and require large amounts of training data. |
| Approach: | They propose a method to train neural machine translation systems to new low-resource languages . they propose to start with massively multilingual "seed models" and continue training on data related to the LRL . |
| Outcome: | The proposed method achieves BLEU scores of up to 15.5 with no data from the LRL and improves over other adaptation methods by 1.7 BLUE points average over 4 LRL settings. |
Similar Papers
An Analysis of Massively Multilingual Neural Machine Translation for Low-Resource Languages (2020.lrec-1)
Copied to clipboard
| Challenge: | In this study, we explore massively multilingual low-resource neural machine translation. |
| Approach: | They propose to use Bible translations to train models with up to 1,107 source languages and create multilingual corpora varying the number and relatedness of source languages. |
| Outcome: | The proposed approach is highly language-specific and can be tailored to the source language and its typology. |
Multilingual Neural Machine Translation (2020.coling-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we will cover the latest advances in NMT to enhance low-resource translation. |
| Approach: | They will cover the latest advances in NMT approaches that leverage multilingualism . they will focus on topics such as language divergence, transfer learning and pivoting . |
| Outcome: | This tutorial will cover the latest advances in NMT to enhance low-resource translation models. |
Many-to-English Machine Translation Tools, Data, and Pretrained Models (2021.acl-demo)
Copied to clipboard
| Challenge: | Commercial translation systems support only one hundred languages or fewer . commercial translation systems do not make these models available for transfer to low resource languages . |
| Approach: | They propose a multilingual neural machine translation model that can translate from 500 source languages to English. |
| Outcome: | The proposed model can translate from 500 source languages to English, or be used as a parent model for low-resource languages. |
Meta-Learning for Low-Resource Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | In this paper, we propose to extend the recently introduced model-agnostic meta-learning algorithm for low-resource neural machine translation (NMT). |
| Approach: | They propose to extend the recently introduced meta-learning algorithm for low-resource neural machine translation (NMT) they frame low-Resource translation as a meta- learning problem where we learn to adapt to low-REsource languages based on multilingual high-resourced language tasks. |
| Outcome: | The proposed meta-learning algorithm outperforms the multilingual, transfer learning based approach and can train a competitive NMT system with only a fraction of training examples. |
Machine Translation into Low-resource Language Varieties (2021.acl-short)
Copied to clipboard
| Challenge: | Current machine translation systems generate a "standard" target language, but many languages have multiple varieties that are different from the standard language. |
| Approach: | They propose a framework to rapidly adapt machine translation systems to generate different target varieties . they propose to use no parallel data to generate languages close to, but different from, the standard target language . |
| Outcome: | The proposed model improves on a system that generates Ukrainian and Belarusian in two languages with no parallel data. |
Universal Neural Machine Translation for Extremely Low Resource Languages (N18-1)
Copied to clipboard
| Challenge: | a novel multilingual approach to machine translation is proposed for low resource languages . the proposed approach can achieve 23 BLEU on Romanian-English WMT2016 using a tiny parallel corpus of 6k sentences compared to the 18 BLUE of strong baseline system . |
| Approach: | They propose a transfer-learning approach to share lexical and sentence representations across multiple source languages into one target language. |
| Outcome: | The proposed approach achieves 23 BLEU on Romanian-English WMT2016 using a tiny parallel corpus of 6k sentences compared to the 18 BLUE of strong baseline system which uses multi-lingual training and back-translation. |
Massively Multilingual Neural Machine Translation (N19-1)
Copied to clipboard
| Challenge: | Multilingual Neural Machine Translation models support translation from multiple source languages into multiple target languages. |
| Approach: | They perform extensive experiments in training massively multilingual NMT models involving up to 103 distinct languages and 204 translation directions simultaneously. |
| Outcome: | The proposed model outperforms the state-of-the-art in low resource settings while supporting up to 59 languages in 116 translation directions. |
Simple, Scalable Adaptation for Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Recent advances in deep learning have led to significantly improved quality on Neural Machine Translation (NMT) however, performance on out-of-domain data or low resource languages remains poor. |
| Approach: | They propose a simple yet efficient approach for adapting pre-trained models to multiple tasks simultaneously. |
| Outcome: | The proposed approach is on par with full fine-tuning on domain adaptation and massively multilingual NMT on a massively multilingual dataset. |
Disentangling Pretrained Representation to Leverage Low-Resource Languages in Multilingual Machine Translation (2024.lrec-main)
Copied to clipboard
| Challenge: | Multilingual neural machine translation requires an enormous dataset, leaving the low-resource language (LRL) underdeveloped. |
| Approach: | They evaluated five languages using a parallel corpus of 1,000 instances each and found a zero-shot improvement of 7.4 from the baseline score of 7.1 to a score of 15.5 at best. |
| Outcome: | The proposed model improves performance in the linguistically diverse country of Indonesia by 7.4 from baseline score of 7.1 to 15.5 at best. |
Efficiently Upgrading Multilingual Machine Translation Models to Support More Languages (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing multilingual machine translation models need to be upgraded as data becomes available in more languages. |
| Approach: | They propose three techniques that speed up the effective learning of new languages and alleviate catastrophic forgetting . |
| Outcome: | The proposed techniques exceed the performance of a same-sized baseline model with 30% computation and recover the performance a larger model trained from scratch with over 50% reduction in computation. |