Improving Domain Adaptation Translation with Domain Invariant and Specific Information (N19-1)
Copied to clipboard
| Challenge: | Neural machine translation models are based on the encoder-decoder architecture, which makes them overfitting to frequent observations. |
| Approach: | They propose a method to explicitly model out-of-domain information in an encoder-decoder framework . they propose combining out- of-domain training data with out-out-of domain data . |
| Outcome: | The proposed method outperforms baselines on multiple data sets. |
Similar Papers
Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for domain adaptation suffer from catastrophic forgetting, large domain divergence, and model explosion. |
| Approach: | They propose a method which prunes the model and keeps the important neurons or parameters responsible for both general-domain and in-domain translation. |
| Outcome: | The proposed method improves on different language pairs and domains compared with strong baselines. |
Unsupervised Domain Adaptation for Neural Machine Translation with Domain-Aware Feature Embeddings (D19-1)
Copied to clipboard
| Challenge: | Recent studies have focused on domain adaptation for neural machine translation systems where in-domain data is scarce or nonexistent. |
| Approach: | They propose an approach that adapts models with domain-aware feature embeddings, which are learned via an auxiliary language modeling task. |
| Outcome: | The proposed model performs better in multiple experimental settings and with back translation. |
Domain Differential Adaptation for Neural Machine Translation (D19-56)
Copied to clipboard
| Challenge: | Neural networks are data hungry and domain sensitive, so it is difficult to obtain labeled data for every domain. |
| Approach: | They propose a framework for domain adaptation where we model the difference between domains instead of smoothing over them. |
| Outcome: | The proposed framework improves on domain adaptation in multiple experimental settings. |
The Trade-offs of Domain Adaptation for Neural Language Models (2022.acl-long)
Copied to clipboard
| Challenge: | Neural Language Models (LMs) trained on large generic training sets have been shown to be effective at adapting to smaller, specific target domains for language modeling and other downstream tasks. |
| Approach: | They propose a framework for a Neural Language Models (LM) to be presented in a common framework. |
| Outcome: | The proposed framework highlights similarities and subtle differences between adaptation techniques and the framework. |
Domain Adaptive Inference for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural Machine Translation models are effective when trained on broad domains with large datasets, such as news translation. |
| Approach: | They propose a novel approach for adaptive ensemble weighting for Neural Machine Translation by extending Bayesian Interpolation with source information. |
| Outcome: | The proposed approach improves performance on Spanish-English and English-German tasks without the need for the domain label. |
Improving the Quality Trade-Off for Neural Machine Translation Multi-Domain Adaptation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Building neural machine translation systems to perform well on a specific target domain remains a challenge. |
| Approach: | They propose to train a single NMT system per language pair that performs well across multiple domains. |
| Outcome: | The proposed approach improves the Pareto frontier on this task. |
Distilling Multiple Domains for Neural Machine Translation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Neural machine translation is a powerful tool for high-resource domains, but performance suffers when the input domain is low-resourced. |
| Approach: | They propose a framework for training a single multi-domain neural machine translation model that can translate multiple domains without increasing inference time or memory usage. |
| Outcome: | The proposed model improves translation on both high- and low-resource domains over strong multi-domain baselines and is robust under noisy data conditions. |
Iterative Dual Domain Adaptation for Neural Machine Translation (D19-1)
Copied to clipboard
| Challenge: | Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of our proposed framework. |
| Approach: | They propose an iterative dual domain adaptation framework for neural machine translation that uses multiple corpora to perform bidirectional translation knowledge transfer. |
| Outcome: | Empirical results on Chinese-English and English-German translation tasks demonstrate the effectiveness of the proposed framework. |
Neural Adaptation Layers for Cross-domain Named Entity Recognition (D18-1)
Copied to clipboard
| Challenge: | Named entity recognition is a type of information extraction task whereby features can be designed based on domain-specific knowledge. |
| Approach: | They propose to use existing neural architectures to adapt to new domains without retraining . they propose to add adaptation layers to existing neural models to minimize re-training based on source data. |
| Outcome: | The proposed approach significantly outperforms state-of-the-art methods on social media domains. |
Adversarial Domain Adaptation Using Artificial Titles for Abstractive Title Generation (P19-1)
Copied to clipboard
| Challenge: | Obtaining good quality labeled data can be difficult and expensive for abstractive summarization models . authors propose the use of artificial titles for unlabeled target documents . |
| Approach: | They propose to use artificial titles and sequential training to capture grammatical style of unlabeled target domains to adapt to/from news articles and Stack Exchange posts. |
| Outcome: | The proposed techniques can boost performance for unsupervised adaptation and fine-tuning with limited target data. |