Triangular Architecture for Rare Language Translation (P18-1)

Copied to clipboard

Challenge: Empirical results show that Neural Machine Translation (NMT) performs poor on low-resource pairs especially when Z is a rare language.
Approach: They propose a triangular triangulation technique to leverage bilingual data to optimize the translation performance of low-resource pairs.
Outcome: Empirical results show that the proposed architecture significantly improves translation quality of rare languages on MultiUN and IWSLT2012 datasets and even better when combining back-translation methods.

Similar Papers

Efficient Neural Machine Translation for Low-Resource Languages via Exploiting Related Languages (2020.acl-srw)

Copied to clipboard

Challenge: Neural Machine Translation (NMT) is a rapidly advancing MT paradigm that can be used to improve machine translation for many languages.
Approach: They propose a technique called Unified Transliteration and Subword Segmentation to leverage language similarity while exploiting parallel data from related languages.
Outcome: The proposed approach improves translation accuracy by 5 BLEU points over the standard Transformer-based NMT models.
Overcoming the Rare Word Problem for low-resource language pairs in Neural Machine Translation (D19-52)

Copied to clipboard

Challenge: Despite above approaches can improve the prediction of rare words, they still have challenges which have adverse effects on its effectiveness.
Approach: They propose three ways to address rare-word problem in neural machine translation systems . they propose an algorithm to learn morphology of unknown words for English in supervised way to minimize adverse effect of rare- word problem.
Outcome: The proposed approaches improve accuracy on two low-resource language pairs.
Meta-Learning for Low-Resource Neural Machine Translation (D18-1)

Copied to clipboard

Challenge: In this paper, we propose to extend the recently introduced model-agnostic meta-learning algorithm for low-resource neural machine translation (NMT).
Approach: They propose to extend the recently introduced meta-learning algorithm for low-resource neural machine translation (NMT) they frame low-Resource translation as a meta- learning problem where we learn to adapt to low-REsource languages based on multilingual high-resourced language tasks.
Outcome: The proposed meta-learning algorithm outperforms the multilingual, transfer learning based approach and can train a competitive NMT system with only a fraction of training examples.
Multilingual Neural Machine Translation (2020.coling-tutorials)

Copied to clipboard

Challenge: In this tutorial, we will cover the latest advances in NMT to enhance low-resource translation.
Approach: They will cover the latest advances in NMT approaches that leverage multilingualism . they will focus on topics such as language divergence, transfer learning and pivoting .
Outcome: This tutorial will cover the latest advances in NMT to enhance low-resource translation models.
Alignment verification to improve NMT translation towards highly inflectional languages with limited resources (2021.eacl-main)

Copied to clipboard

Challenge: Existing approaches to improve translation quality using limited training data are phrase-based and syntax-based approaches.
Approach: They propose to combine a neural MT system with an open source module to improve translation quality.
Outcome: The proposed method improves translation quality over the best individual NMT and the standard ensemble system provided in the Marian-NMT system.
Triangular Transfer: Freezing the Pivot for Triangular Machine Translation (2022.acl-short)

Copied to clipboard

Challenge: Existing approaches to triangular machine translation have not fully exploited all types of auxiliary data.
Approach: They propose a transfer-learning-based approach that utilizes all types of auxiliary data.
Outcome: The proposed approach outperforms existing approaches with a series of experiments.
Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translation (2020.acl-main)

Copied to clipboard

Challenge: Existing approaches to improve multilingual neural machine translation (NMT) are weak, and lack robustness to support language pairs with varying typological characteristics.
Approach: They propose to deepen NMT models to support language pairs with varying typological characteristics by random online backtranslation.
Outcome: The proposed approach narrows the performance gap with bilingual models and improves zero-shot performance by 10 BLEU, approaching conventional pivot-based methods.
Training and Adapting Multilingual NMT for Less-resourced and Morphologically Rich Languages (L18-1)

Copied to clipboard

Challenge: Using multilingual and multi-way neural machine translation approaches is a major advantage . training NMT systems for individual language pairs takes significantly more time than training of SMT systems .
Approach: They propose to employ multilingual and multi-way neural machine translation approaches for morphologically rich languages such as Estonian and Russian.
Outcome: The proposed approach improves translation quality by +3.27 BLEU points over baseline models.
Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data (2021.acl-long)

Copied to clipboard

Challenge: linguistic overlap between low-resource languages and high-resourced languages is a major obstacle for training high-quality machine translation systems.
Approach: They exploit linguistic overlap to facilitate translation to and from low-resource languages . they use monolingual data and parallel data in related high-resourced languages based on their method .
Outcome: The proposed method significantly improves translation into low-resource language compared to baselines on 7 languages from three different language families.
A Simple and Fast Strategy for Handling Rare Words in Neural Machine Translation (2022.aacl-srw)

Copied to clipboard

Challenge: Neural Machine Translation (NMT) has been gaining popularity due to its ability to bias in highfrequency words, low-frequency words have little chance of being considered in the inference process.
Approach: They propose a strategy for integrating constraints during the training and decoding process to improve the translation of rare words.
Outcome: The proposed approach improves translation of rare words in high and low-resource translation tasks, showing improvements of up to +1.8 BLEU scores over baseline systems.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations