Challenge: Recent research on domain adaptation neglects diversity in translation within a domain . current research on NMT models considers very broad target domains .
Approach: They propose a fine-grained domain adaptation task for autonomous vehicles, AI education, real-time networks, and smart phone.
Outcome: The proposed task is compared with a dataset of Chinese-English translation tasks for four sub-domains of information technology: autonomous vehicles, AI education, real-time networks, and smart phone.

Similar Papers

A Survey of Domain Adaptation for Neural Machine Translation (C18-1)

Copied to clipboard

Challenge: Neural machine translation (NMT) is a deep learning based approach for machine translation.
Approach: They propose to use a deep learning approach to train machine translation in scenarios where large-scale parallel corpora are available.
Outcome: The proposed approach yields the state-of-the-art translation performance in resource rich scenarios.
Simple, Scalable Adaptation for Neural Machine Translation (D19-1)

Copied to clipboard

Challenge: Recent advances in deep learning have led to significantly improved quality on Neural Machine Translation (NMT) however, performance on out-of-domain data or low resource languages remains poor.
Approach: They propose a simple yet efficient approach for adapting pre-trained models to multiple tasks simultaneously.
Outcome: The proposed approach is on par with full fine-tuning on domain adaptation and massively multilingual NMT on a massively multilingual dataset.
Domain Adaptive Inference for Neural Machine Translation (P19-1)

Copied to clipboard

Challenge: Neural Machine Translation models are effective when trained on broad domains with large datasets, such as news translation.
Approach: They propose a novel approach for adaptive ensemble weighting for Neural Machine Translation by extending Bayesian Interpolation with source information.
Outcome: The proposed approach improves performance on Spanish-English and English-German tasks without the need for the domain label.
From Priest to Doctor: Domain Adaptation for Low-Resource Neural Machine Translation (2025.coling-main)

Copied to clipboard

Challenge: Existing data for low-resource languages are limited; the languages that could most benefit from domain adaptation (DA) are the ones left behind.
Approach: They propose a realistic setting in which they aim to translate between a high-resource and a low-resourced language with limited parallel data, a bilingual dictionary, and c) a monolingual target-domain corpus in the high-rsource language.
Outcome: The proposed methods are compared with a human evaluation of DALI and show that the most effective is the simplest.
Reference Free Domain Adaptation for Translation of Noisy Questions with Question Specific Rewards (2023.findings-emnlp)

Copied to clipboard

Challenge: Creating a synthetic parallel corpus from noisy data is also difficult due to its noisy nature.
Approach: They propose a training methodology that fine-tunes the NMT system only using source-side data to balance adequacy and fluency.
Outcome: The proposed method surpasses the MLE-based fine-tuning approach by achieving a 1.9 BLEU improvement.
Vocabulary Adaptation for Domain Adaptation in Neural Machine Translation (2020.findings-emnlp)

Copied to clipboard

Challenge: Neural network methods exhibit strong performance only in a few resource-rich domains.
Approach: They propose a method that fine-tunes embedding layers of a pre-trained NMT model to the target domain.
Outcome: The proposed method improves fine-tuning performance in En-Ja and De-En translation by 3.86 and 3.28 BLEU points.
Enhancing Neural Machine Translation Through Target Language Data: A kNN-LM Approach for Domain Adaptation (2025.acl-long)

Copied to clipboard

Challenge: Neural machine translation (NMT) has made significant progress in recent years, yet often suffers from translating in new domains, which is called domain adaptation.
Approach: They propose a method that leverages semantically similar target language sentences in the kNN framework and generates a probability distribution over these sentences during decoding.
Outcome: The proposed method generates a probability distribution over similar target language sentences and then interpolates with the model’s distribution.
A Reinforcement Learning Approach to Improve Low-Resource Machine Translation Leveraging Domain Monolingual Data (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for fine-tuning domain adaptation have overfitting problem in low-resource domains . lack of parallel data makes it difficult for model to learn domain-specific knowledge .
Approach: They propose a Reinforcement Learning Domain Adaptation method for Neural Machine Translation that uses in-domain source monolingual data to make up for the lack of parallel data.
Outcome: The proposed method can alleviate overfitting and reinforce the model to learn domain-specific knowledge.
Beyond Noise: Mitigating the Impact of Fine-grained Semantic Divergences on Neural Machine Translation (2021.acl-long)

Copied to clipboard

Challenge: Prior work treats all types of mismatches between source and target as noise . Consequently, it remains unclear how noisy parallel training samples impact NMT training.
Approach: They propose a divergent-aware NMT framework that uses factors to help NMT recover from the degradation caused by naturally occurring divergences.
Outcome: The proposed framework improves translation quality and model calibration on EN-FR tasks.
Improving the Quality Trade-Off for Neural Machine Translation Multi-Domain Adaptation (2021.emnlp-main)

Copied to clipboard

Challenge: Building neural machine translation systems to perform well on a specific target domain remains a challenge.
Approach: They propose to train a single NMT system per language pair that performs well across multiple domains.
Outcome: The proposed approach improves the Pareto frontier on this task.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations