Challenge: Neural machine translation (NMT) is a deep learning based approach for machine translation.
Approach: They propose to use a deep learning approach to train machine translation in scenarios where large-scale parallel corpora are available.
Outcome: The proposed approach yields the state-of-the-art translation performance in resource rich scenarios.

Similar Papers

Domain Adaptation of Neural Machine Translation by Lexicon Induction (P19-1)

Copied to clipboard

Challenge: Neural machine translation (NMT) is sensitive to domain shift, resulting in failure for sentences with large numbers of unknown words and lack of supervision for domain-specific words.
Approach: They propose an unsupervised method which fine-tunes a pre-trained out-of-domain NMT model using a pseudo-in-domain corpus.
Outcome: The proposed method improves in five domains without using in-domain parallel sentences and up to 2 BLEU over strong back-translation baselines.
Non-Parametric Unsupervised Domain Adaptation for Neural Machine Translation (2021.findings-emnlp)

Copied to clipboard

Challenge: kNN-MT is a non-parametric method that uses nearest neighbor retrieval to translate out-of-domain sentences, rare words, etc.
Approach: They propose a framework that directly uses in-domain monolingual sentences to build an effective datastore for k-nearest-neighbor retrieval.
Outcome: The proposed framework improves translation accuracy with target-side monolingual data while achieving comparable performance with back-translation.
Generalised Unsupervised Domain Adaptation of Neural Machine Translation with Cross-Lingual Data Selection (2021.emnlp-main)

Copied to clipboard

Challenge: Existing work on unsupervised domain adaptation of neural machine translation assumes access to monolingual text in either the source or target language in the new domain.
Approach: They propose a method to extract in-domain sentences from a large generic monolingual corpus from 'missing' text.
Outcome: The proposed method outperforms baselines up to +1.5 BLEU score on five diverse domains in three language pairs and a real-world translation scenario.
Multilingual Neural Machine Translation (2020.coling-tutorials)

Copied to clipboard

Challenge: In this tutorial, we will cover the latest advances in NMT to enhance low-resource translation.
Approach: They will cover the latest advances in NMT approaches that leverage multilingualism . they will focus on topics such as language divergence, transfer learning and pivoting .
Outcome: This tutorial will cover the latest advances in NMT to enhance low-resource translation models.
Simple, Scalable Adaptation for Neural Machine Translation (D19-1)

Copied to clipboard

Challenge: Recent advances in deep learning have led to significantly improved quality on Neural Machine Translation (NMT) however, performance on out-of-domain data or low resource languages remains poor.
Approach: They propose a simple yet efficient approach for adapting pre-trained models to multiple tasks simultaneously.
Outcome: The proposed approach is on par with full fine-tuning on domain adaptation and massively multilingual NMT on a massively multilingual dataset.
Iterative Dual Domain Adaptation for Neural Machine Translation (D19-1)

Copied to clipboard

Challenge: Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of our proposed framework.
Approach: They propose an iterative dual domain adaptation framework for neural machine translation that uses multiple corpora to perform bidirectional translation knowledge transfer.
Outcome: Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of the proposed framework.
Multi-Domain Neural Machine Translation with Word-Level Domain Context Discrimination (D18-1)

Copied to clipboard

Challenge: Experimental results on Chinese-English and English-French multi-domain translation tasks demonstrate the effectiveness of the proposed model.
Approach: They propose to use mixed-domain parallel sentences to construct a unified model that allows translation to switch between different domains.
Outcome: The proposed model distinguishes and exploits word-level domain contexts on Chinese-English and English-French translation tasks.
Domain Adaptive Inference for Neural Machine Translation (P19-1)

Copied to clipboard

Challenge: Neural Machine Translation models are effective when trained on broad domains with large datasets, such as news translation.
Approach: They propose a novel approach for adaptive ensemble weighting for Neural Machine Translation by extending Bayesian Interpolation with source information.
Outcome: The proposed approach improves performance on Spanish-English and English-German tasks without the need for the domain label.
From Priest to Doctor: Domain Adaptation for Low-Resource Neural Machine Translation (2025.coling-main)

Copied to clipboard

Challenge: Existing data for low-resource languages are limited; the languages that could most benefit from domain adaptation (DA) are the ones left behind.
Approach: They propose a realistic setting in which they aim to translate between a high-resource and a low-resourced language with limited parallel data, a bilingual dictionary, and c) a monolingual target-domain corpus in the high-rsource language.
Outcome: The proposed methods are compared with a human evaluation of DALI and show that the most effective is the simplest.
Enhancing Neural Machine Translation Through Target Language Data: A kNN-LM Approach for Domain Adaptation (2025.acl-long)

Copied to clipboard

Challenge: Neural machine translation (NMT) has made significant progress in recent years, yet often suffers from translating in new domains, which is called domain adaptation.
Approach: They propose a method that leverages semantically similar target language sentences in the kNN framework and generates a probability distribution over these sentences during decoding.
Outcome: The proposed method generates a probability distribution over similar target language sentences and then interpolates with the model’s distribution.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations