| Challenge: | a recent study has explored the use of vetted terminology in neural machine translation . a number of organizations use domain- or organization-specific words and phrases . |
| Approach: | They propose a method for injecting terminology and for evaluating terminology injection. |
| Outcome: | The proposed method is based on the long-term memory (LSTM) attention mechanism prevalent in state-of-the-art systems . it also introduces a new translation metric more sensitive to approved terminological content in MT output. |
Similar Papers
On the Word Alignment from Neural Machine Translation (P19-1)
Copied to clipboard
| Challenge: | Prior researches suggest that neural machine translation (NMT) captures word alignment through its attention mechanism, however, attention may fail to capture word alignment for some NMT models. |
| Approach: | They propose two methods to induce word alignment which are general and agnostic to specific NMT models. |
| Outcome: | The proposed methods induce much better word alignment than attention. |
Better Neural Machine Translation by Extracting Linguistic Information from BERT (2021.eacl-main)
Copied to clipboard
| Challenge: | Experimental results show that incorporating linguistic information into neural machine translation models is no more difficult to train than conventional Transformer-based NMT. |
| Approach: | They propose to extract linguistic information from contextual word embeddings instead of point estimates to augment NMT models. |
| Outcome: | The proposed method generalizes better in a variety of training contexts and is no more difficult to train than conventional Transformer-based NMT. |
Neural Machine Translation Decoding with Terminology Constraints (N18-2)
Copied to clipboard
| Challenge: | Constrained neural machine translation systems can provide excellent quality but do not strictly enforce terminology. |
| Approach: | They propose a framework for constrained neural decoding which supports target-side constraints as well as constraints with corresponding aligned input text spans. |
| Outcome: | The proposed framework performs well on multiple translation tasks and motivates the need for constrained decoding with attentions to reduce misplacement and duplication when translating user constraints. |
Evaluating Explanation Methods for Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) has seen great success during recent years. |
| Approach: | They propose a metric that measures the fidelity of explanation methods on translation tasks . they use an efficient approximation to evaluate several explanation methods . |
| Outcome: | The proposed metric is efficient and can be used on translation tasks. |
Training Neural Machine Translation to Apply Terminology Constraints (P19-1)
Copied to clipboard
| Challenge: | Existing methods to integrate domain terminology into neural machine translation (NMT) are brittle when tested in real-world situations. |
| Approach: | They propose a method to inject custom terminology into neural machine translation at run time by using the target side of terminology entries whose source side match the input as decoding-time constraints. |
| Outcome: | The proposed method is faster than state-of-the-art decoding and more efficient than constraint-free decoding. |
Extract and Attend: Improving Entity Translation in Neural Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to improve entity translation in Neural machine translation still suffer from inaccurate translation of entities due to the lack of entity training instances. |
| Approach: | They propose an extract-and-tend approach to enhance entity translation in NMT by extracting entities from a dictionary and attending to them with a prefix. |
| Outcome: | Experiments on En-Zh and En-Ru show that the proposed approach improves translation accuracy and translation quality. |
Learning Source Phrase Representations for Neural Machine Translation (2020.acl-main)
Copied to clipboard
| Challenge: | Existing approaches to machine translation have been shown to be effective for long sentences . however, the attentional network can't capture long-distance dependencies . |
| Approach: | They propose a multi-head attention mechanism which generates phrase representations from token representations and incorporates them into the Transformer translation model to enhance its ability to capture long-distance relationships. |
| Outcome: | The proposed model can be computed in parallel and improves on the WMT 14 tasks. |
On Search Strategies for Document-Level Neural Machine Translation (2023.findings-acl)
Copied to clipboard
| Challenge: | Document-level neural machine translation models produce a more consistent output across a document . however, the exact decoding strategy is often not described and not mentioned at all. |
| Approach: | They propose to use standard automatic metrics and specific linguistic phenomena to compare different decoding schemes. |
| Outcome: | The proposed decoding strategies perform similar to each other on three standard document-level translation benchmarks. |
Towards Opening the Black Box of Neural Machine Translation: Source and Target Interpretations of the Transformer (2022.emnlp-main)
Copied to clipboard
| Challenge: | Neural Machine Translation (NMT) relies on source sentence and target prefix attributions for each input token. |
| Approach: | They propose an interpretability method that tracks input tokens’ attributions for both contexts and extends it to any encoder-decoder Transformer-based model. |
| Outcome: | The proposed method can be extended to any encoder-decoder Transformer-based model and provides insights into their behaviour. |
A Survey of Domain Adaptation for Neural Machine Translation (C18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) is a deep learning based approach for machine translation. |
| Approach: | They propose to use a deep learning approach to train machine translation in scenarios where large-scale parallel corpora are available. |
| Outcome: | The proposed approach yields the state-of-the-art translation performance in resource rich scenarios. |