Overcoming the Rare Word Problem for low-resource language pairs in Neural Machine Translation (D19-52)
Copied to clipboard
| Challenge: | Despite above approaches can improve the prediction of rare words, they still have challenges which have adverse effects on its effectiveness. |
| Approach: | They propose three ways to address rare-word problem in neural machine translation systems . they propose an algorithm to learn morphology of unknown words for English in supervised way to minimize adverse effect of rare- word problem. |
| Outcome: | The proposed approaches improve accuracy on two low-resource language pairs. |
Similar Papers
A Simple and Fast Strategy for Handling Rare Words in Neural Machine Translation (2022.aacl-srw)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) has been gaining popularity due to its ability to bias in highfrequency words, low-frequency words have little chance of being considered in the inference process. |
| Approach: | They propose a strategy for integrating constraints during the training and decoding process to improve the translation of rare words. |
| Outcome: | The proposed approach improves translation of rare words in high and low-resource translation tasks, showing improvements of up to +1.8 BLEU scores over baseline systems. |
Byte-based Multilingual NMT for Endangered Languages (2022.coling-1)
Copied to clipboard
| Challenge: | Existing work has not studied how byte encoding can benefit endangered languages . multilingual neural machine translation (MNMT) models suffer from out-of-vocabulary issues and representation bottleneck . |
| Approach: | They propose a multilingual multilingual neural machine translation system to alleviate the representation bottleneck and improve translation performance in endangered languages. |
| Outcome: | The proposed system outperforms subword-based models on twelve languages up to +18.5 BLEU points, an 840% relative improvement over baseline models. |
Salute the Classic: Revisiting Challenges of Machine Translation in the Age of Large Language Models (2025.tacl-1)
Copied to clipboard
| Challenge: | a recent study revisits six core challenges that have influenced the evolution of Neural Machine Translation (NMT) domain mismatch, amount of parallel data, rare word prediction, translation of long sentences and sub-optimal beam search remain challenges in LLMs. |
| Approach: | They revisit core challenges that have acted as benchmarks for progress in NMT . they propose to revisit these challenges and offer insights into their relevance . |
| Outcome: | The proposed models significantly improve translation of sentences containing approximately 80 words, even translating documents up to 512 words. |
Efficient Neural Machine Translation for Low-Resource Languages via Exploiting Related Languages (2020.acl-srw)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) is a rapidly advancing MT paradigm that can be used to improve machine translation for many languages. |
| Approach: | They propose a technique called Unified Transliteration and Subword Segmentation to leverage language similarity while exploiting parallel data from related languages. |
| Outcome: | The proposed approach improves translation accuracy by 5 BLEU points over the standard Transformer-based NMT models. |
Addressing word-order Divergence in Multilingual Neural Machine Translation for extremely Low Resource Languages (N19-1)
Copied to clipboard
| Challenge: | Existing studies show that transfer learning works best when the languages are related. |
| Approach: | They propose to pre-order assisting language sentences to match the word order of the source language and train the parent model. |
| Outcome: | The proposed model can improve translation quality in low-resource scenarios by pre-ordering the assisting language sentences to match the word order of the source language and training the parent model. |
Improving Low-Resource NMT through Relevance Based Linguistic Features Incorporation (2020.coling-main)
Copied to clipboard
| Challenge: | Existing studies on incorporating arbitrary syntactic information into neural machine translation (NMT) are lacking. |
| Approach: | They propose to integrate linguistic knowledge at different levels into neural machine translation framework to improve translation quality for language pairs with extremely limited data. |
| Outcome: | The proposed methods improve translation quality for all tasks by 3.09 BLEU points . the proposed methods are based on two different approaches . |
Revisiting Low-Resource Neural Machine Translation: A Case Study (P19-1)
Copied to clipboard
| Challenge: | Recent research has shown that neural machine translation models are highly data-inefficient and underperform phrase-based statistical machine translation (PBSMT) in low-resource settings. |
| Approach: | They propose to use auxiliary data to train low-resource neural machine translation systems without auxiliary monolingual or multilingual data. |
| Outcome: | The proposed methods outperform PBSMT and other statistical machine translation models in Korean–English with minimal data. |
Multimodal Machine Translation with Embedding Prediction (N19-3)
Copied to clipboard
| Challenge: | Pretrained word embeddings improve multimodal machine translation of low-resource domains due to a shortage of training data. |
| Approach: | They propose to combine pretrained word embeddings with search-based approaches to improve NMT of low-resource domains to better translate rare words. |
| Outcome: | The proposed approach improves translation performance by 1.24 METEOR and 2.49 BLEU and achieves 7.67 F-score. |
Meta-Learning for Low-Resource Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | In this paper, we propose to extend the recently introduced model-agnostic meta-learning algorithm for low-resource neural machine translation (NMT). |
| Approach: | They propose to extend the recently introduced meta-learning algorithm for low-resource neural machine translation (NMT) they frame low-Resource translation as a meta- learning problem where we learn to adapt to low-REsource languages based on multilingual high-resourced language tasks. |
| Outcome: | The proposed meta-learning algorithm outperforms the multilingual, transfer learning based approach and can train a competitive NMT system with only a fraction of training examples. |
Multilingual Neural Machine Translation (2020.coling-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we will cover the latest advances in NMT to enhance low-resource translation. |
| Approach: | They will cover the latest advances in NMT approaches that leverage multilingualism . they will focus on topics such as language divergence, transfer learning and pivoting . |
| Outcome: | This tutorial will cover the latest advances in NMT to enhance low-resource translation models. |