Measuring Immediate Adaptation Performance for Neural Machine Translation (N19-1)
Copied to clipboard
| Challenge: | Incremental domain adaptation improves interactive machine translation performance . users of interactive systems are sensitive to the speed of adaptation . |
| Approach: | They propose to measure the speed of lexical acquisition for in-domain vocabulary . they propose to use this to choose the most suitable adaptation method for neural machine translation . |
| Outcome: | The proposed measures measure the speed of lexical acquisition for in-domain vocabulary . they show that the most suitable adaptation method is chosen from a range of different techniques . |
Similar Papers
Evaluating Domain Adaptation for Machine Translation Across Scenarios (L18-1)
Copied to clipboard
| Challenge: | Statistical machine translation (SMT) has been the dominant approach for the last 20 years, with neural machine translation becoming the new main paradigm in academic research and the industry. |
| Approach: | They propose to compare domain-adapted statistical and neural machine translation systems on three different domains and language pairs with varying degrees of domain specificity and available training data. |
| Outcome: | The proposed system is the best choice for translation, with marked impacts for domains with higher specificity. |
Domain Adaptive Inference for Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Neural Machine Translation models are effective when trained on broad domains with large datasets, such as news translation. |
| Approach: | They propose a novel approach for adaptive ensemble weighting for Neural Machine Translation by extending Bayesian Interpolation with source information. |
| Outcome: | The proposed approach improves performance on Spanish-English and English-German tasks without the need for the domain label. |
A Survey of Domain Adaptation for Neural Machine Translation (C18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is a deep learning based approach for machine translation. |
| Approach: | They propose to use a deep learning approach to train machine translation in scenarios where large-scale parallel corpora are available. |
| Outcome: | The proposed approach yields the state-of-the-art translation performance in resource rich scenarios. |
Evaluating Automatic Metrics with Incremental Machine Translation Systems (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have shown that neural metrics are more reliable than non-neural metrics. |
| Approach: | They propose to use commercial machine translations to evaluate machine translation metrics based on their preference for more recent outputs. |
| Outcome: | The proposed dataset confirms several previous findings, including the advantage of neural metrics over non-neural ones, and also explores the debated issue of how MT quality affects metric reliability. |
Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for judging metrics are sensitive to the translations used for evaluation, leading to falsely confident conclusions about a metric’s efficacy. |
| Approach: | They propose a method for thresholding performance improvement under an automatic metric against human judgements by using a pairwise system ranking method. |
| Outcome: | The proposed method allows quantification of type I versus type II errors incurred, i.e., insignificant human differences in system quality that are accepted, and significant human differences that are rejected. |
Rapid Adaptation of Neural Machine Translation to New Languages (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to adapt neural machine translation systems to low-resource languages are difficult to implement and require large amounts of training data. |
| Approach: | They propose a method to train neural machine translation systems to new low-resource languages . they propose to start with massively multilingual "seed models" and continue training on data related to the LRL . |
| Outcome: | The proposed method achieves BLEU scores of up to 15.5 with no data from the LRL and improves over other adaptation methods by 1.7 BLUE points average over 4 LRL settings. |
Machine Translation of Restaurant Reviews: New Corpus for Domain Adaptation and Robustness (D19-56)
Copied to clipboard
Alexandre Berard, Ioan Calapodescu, Marc Dymetman, Claude Roux, Jean-Luc Meunier, Vassilina Nikoulina
| Challenge: | BLEU: MT is a very robust and efficient way to translate user-generated content. |
| Approach: | They propose a task to encourage research on MT robustness and domain adaptation . they ask professionals to translate 11.5k french 4SQ reviews to English . |
| Outcome: | The proposed task improves on the existing MT systems in a real-world scenario . the proposed methods improve translation accuracy and sentiment analysis . |
Extending a Parser to Distant Domains Using a Few Dozen Partially Annotated Examples (P18-1)
Copied to clipboard
| Challenge: | Statistical parsers are often criticized for their performance outside of the domain they were trained on . we show that word representations reduce the need for domain adaptation when the target domain is syntactically similar to the source domain. |
| Approach: | They propose a way to adapt a parser to a syntactically similar target domain using partial annotations. |
| Outcome: | The proposed model increases the accuracy of a parser on the Wall Street Journal by 1.7% over the previous state-of-the-art model. |
Domain Adaptation of Neural Machine Translation by Lexicon Induction (P19-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is sensitive to domain shift, resulting in failure for sentences with large numbers of unknown words and lack of supervision for domain-specific words. |
| Approach: | They propose an unsupervised method which fine-tunes a pre-trained out-of-domain NMT model using a pseudo-in-domain corpus. |
| Outcome: | The proposed method improves in five domains without using in-domain parallel sentences and up to 2 BLEU over strong back-translation baselines. |
Extreme Adaptation for Personalized Neural Machine Translation (P18-2)
Copied to clipboard
| Challenge: | Existing models that capture speaker-related variations do not include explicit information about the speaker. |
| Approach: | They propose a method that adapts the bias of the output softmax to each particular user . they propose to model speaker-related variations as an additional bias vector in the softmax layer . |
| Outcome: | The proposed technique improves translation accuracy and better reflection of speaker traits in target text. |