| Challenge: | Existing approaches to integrate source syntax into neural machine translations use linearized parses. |
| Approach: | They propose a linearized parsed neural machine translation technique that integrates source syntax into neural machine learning. |
| Outcome: | The proposed model improves over seq2seq and parsed baselines by over 1 BLEU on the WMT17 English-German task. |
Similar Papers
Improving Multilingual Neural Machine Translation with Auxiliary Source Languages (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work has shown that translating from multiple source languages improves translation quality. |
| Approach: | They propose to exploit multiple source sentences from auxiliary languages to improve multilingual translation in a more common scenario by using synthetic multi-source corpora. |
| Outcome: | Extensive experiments on Chinese/English-Japanese and a large-scale multilingual translation benchmark show that the proposed model outperforms the baseline model significantly by +4.0 BLEU. |
Neural Machine Translation for Bilingually Scarce Scenarios: a Deep Multi-Task Learning Approach (N18-1)
Copied to clipboard
| Challenge: | Neural machine translation requires large amount of parallel training text to learn a reasonable quality translation model. |
| Approach: | They propose a multi-task learning approach that leverages monolingual linguistic resources in the source side of a machine translation task. |
| Outcome: | The proposed approach is effective on three translation tasks: English-to-French, English- to-Farsi, and English-à-Vietnamese. |
Top-down Tree Structured Decoding with Syntactic Connections for Neural Machine Translation and Parsing (D18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) models are based on sequential decoding or serialisation of structured data into sequence. |
| Approach: | They propose a model that combines sequential encoder with tree-structured decoding augmented with a syntax-aware attention model. |
| Outcome: | The proposed model produces fluent translations with better reordering than previous models. |
Improving a Multi-Source Neural Machine Translation Model with Corpus Extension for Low-Resource Languages (L18-1)
Copied to clipboard
| Challenge: | In machine translation, we often try to collect resources to improve performance. |
| Approach: | They propose to use synthetic methods to extend low-resource corpus to create target sentences using synthetic methods. |
| Outcome: | The proposed method improves translation performance for low-resource language pairs. |
Syntax-Based Attention Masking for Neural Machine Translation (2021.naacl-srw)
Copied to clipboard
| Challenge: | Existing approaches to extend transformers to source-side trees are linearized into sequences, but they are limited by positional encodings. |
| Approach: | They propose a method for extending transformers to source-side trees by using masks based on tree positions . they define a number of masks that limit self-attention based upon relationships among tree nodes . |
| Outcome: | The proposed method improves on translations from English to germany and English to english and germany by +2.1 BLEU. |
Tied Multitask Learning for Neural Speech Translation (N18-1)
Copied to clipboard
| Challenge: | Recent efforts in endangered language documentation focus on collecting spoken language resources . BULB project uses mobile app to collect spoken resources accompanied by spoken translations . |
| Approach: | They propose a model where the second task decoder receives information from the first task . they apply regularization that encourages transitivity and invertibility to the model . |
| Outcome: | The proposed model improves performance on low-resource speech transcription and translation tasks. |
An Analysis of Massively Multilingual Neural Machine Translation for Low-Resource Languages (2020.lrec-1)
Copied to clipboard
| Challenge: | In this study, we explore massively multilingual low-resource neural machine translation. |
| Approach: | They propose to use Bible translations to train models with up to 1,107 source languages and create multilingual corpora varying the number and relatedness of source languages. |
| Outcome: | The proposed approach is highly language-specific and can be tailored to the source language and its typology. |
Syntax-Enhanced Neural Machine Translation with Syntax-Aware Word Representations (N19-1)
Copied to clipboard
| Challenge: | Syntax integration has been demonstrated highly effective in neural machine translation (NMT). |
| Approach: | They propose a method to integrate source-side syntax implicitly for neural machine translation . they use hidden representations of a well-trained end-to-end dependency parser to concatenate them with ordinary word embeddings to enhance basic NMT models. |
| Outcome: | The proposed method outperforms existing methods on two translation tasks . it can be easily integrated into the widely-used sequence-to-sequence (Seq2Sequen) framework . |
Multilingual Neural Machine Translation (2020.coling-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we will cover the latest advances in NMT to enhance low-resource translation. |
| Approach: | They will cover the latest advances in NMT approaches that leverage multilingualism . they will focus on topics such as language divergence, transfer learning and pivoting . |
| Outcome: | This tutorial will cover the latest advances in NMT to enhance low-resource translation models. |
Exploiting Deep Representations for Neural Machine Translation (D18-1)
Copied to clipboard
| Challenge: | Neural machine translation models typically implement encoder and decoder as multiple layers, but only the top layers are leveraged in the subsequent process, which misses the opportunity to exploit useful information embedded in other layers. |
| Approach: | They propose to expose all of these signals with layer aggregation and multi-layer attention mechanisms and introduce an auxiliary regularization term to encourage different layers to capture diverse information. |
| Outcome: | The proposed approach exposes all of these signals with layer aggregation and multi-layer attention mechanisms on widely-used translation datasets. |