Iterative Constrained Back-Translation for Unsupervised Domain Adaptation of Machine Translation (2022.coling-1)
Copied to clipboard
| Challenge: | Existing back-translation methods focus on in-domain lexical knowledge, which may lead to poor translation of unseen in- domain words. |
| Approach: | They propose an iterative constrained back-translation method to incorporate in-domain lexical knowledge into synthetic parallel data from BT. |
| Outcome: | The proposed method improves the BLEU score by up to 3.08 on four domains. |
Similar Papers
Domain Adaptation of Neural Machine Translation by Lexicon Induction (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is sensitive to domain shift, resulting in failure for sentences with large numbers of unknown words and lack of supervision for domain-specific words. |
| Approach: | They propose an unsupervised method which fine-tunes a pre-trained out-of-domain NMT model using a pseudo-in-domain corpus. |
| Outcome: | The proposed method improves in five domains without using in-domain parallel sentences and up to 2 BLEU over strong back-translation baselines. |
Improving Lexically Constrained Neural Machine Translation with Source-Conditioned Masked Span Prediction (2021.acl-short)
Copied to clipboard
| Challenge: | Accurate terminology translation is crucial for ensuring the practicality and reliability of neural machine translation systems. |
| Approach: | They propose a method to preserve terminology in translations as lexical constraints with or without a term dictionary at test time. |
| Outcome: | The proposed setup achieves consistent improvements on terminology and sentence-level translation for three domain-specific corpora in two language pairs. |
Iterative Domain-Repaired Back-Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies show that NMT models perform poorly in specific domains when in-domain parallel corpora are scarce or nonexistent. |
| Approach: | They propose an iterative domain-repaired back-translation framework to refine translations in bilingual data by round-trip translating monolingual sentences. |
| Outcome: | The proposed framework achieves 15.79 and 4.47 BLEU improvements over unadapted models and back-translation in domain-specific translations. |
Filtering Back-Translated Data in Unsupervised Neural Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Current state of the art approaches for unsupervised neural machine translation (NMT) use only monolingual data for training. |
| Approach: | They propose an approach to filter back-translated data as part of the training process of unsupervised neural machine translation (NMT) they propose a weight component based on the quality of pseudo parallel sentence pairs generated in back-translation phase. |
| Outcome: | The proposed approach improves the training performance of unsupervised neural machine translation systems by giving weight to good pseudo parallel sentence pairs in the back-translation phase. |
Non-Parametric Unsupervised Domain Adaptation for Neural Machine Translation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | kNN-MT is a non-parametric method that uses nearest neighbor retrieval to translate out-of-domain sentences, rare words, etc. |
| Approach: | They propose a framework that directly uses in-domain monolingual sentences to build an effective datastore for k-nearest-neighbor retrieval. |
| Outcome: | The proposed framework improves translation accuracy with target-side monolingual data while achieving comparable performance with back-translation. |
Iterative Nearest Neighbour Machine Translation for Unsupervised Domain Adaptation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for supervised domain adaptation of machine translation focus on fine-tuning, which is non-extensible. |
| Approach: | They propose to perform unsupervised domain adaptation in a non-parametric manner by using in-domain monolingual data and performing nearest neighbour inference on both forward and backward directions. |
| Outcome: | The proposed method significantly improves the in-domain translation performance and achieves state-of-the-art results among non-parametric methods. |
Iterative Dual Domain Adaptation for Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of our proposed framework. |
| Approach: | They propose an iterative dual domain adaptation framework for neural machine translation that uses multiple corpora to perform bidirectional translation knowledge transfer. |
| Outcome: | Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of the proposed framework. |
Neighbors Are Not Strangers: Improving Non-Autoregressive Translation under Low-Frequency Lexical Constraints (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to lexically constrained neural machine translation suffer from high latency. |
| Approach: | They propose a plug-in algorithm for non-autoregressive translation for this problem . they propose ACT to familiarize the model with the source-side context of constraints . |
| Outcome: | The proposed model improves over the backbone constrained NAT model in constraint preservation and translation quality, especially for rare constraints. |
Neural Machine Translation Decoding with Terminology Constraints (N18-2)
Copied to clipboard
| Challenge: | Constrained neural machine translation systems can provide excellent quality but do not strictly enforce terminology. |
| Approach: | They propose a framework for constrained neural decoding which supports target-side constraints as well as constraints with corresponding aligned input text spans. |
| Outcome: | The proposed framework performs well on multiple translation tasks and motivates the need for constrained decoding with attentions to reduce misplacement and duplication when translating user constraints. |
Unsupervised Domain Adaptation for Neural Machine Translation with Domain-Aware Feature Embeddings (D19-1)
Copied to clipboard
| Challenge: | Recent studies have focused on domain adaptation for neural machine translation systems where in-domain data is scarce or nonexistent. |
| Approach: | They propose an approach that adapts models with domain-aware feature embeddings, which are learned via an auxiliary language modeling task. |
| Outcome: | The proposed model performs better in multiple experimental settings and with back translation. |