Papers by Kenji Imamura
Multilingual Parallel Corpus for Global Communication Plan (L18-1)
Copied to clipboard
| Challenge: | In this paper, we introduce the Global Communication Plan (GCP) Corpus . the corpus is sentence-aligned and covers ten languages, including many Asian languages . |
| Approach: | They introduce the Global Communication Plan (GCP) Corpus, a multilingual parallel corpus . it is sentence-aligned and covers ten languages, including many Asian languages . |
| Outcome: | The proposed corpus is sentence-aligned and covers ten languages, including many Asian languages. |
Long Warm-up and Self-Training: Training Strategies of NICT-2 NMT System at WAT-2019 (D19-52)
Copied to clipboard
| Challenge: | NICT-2 neural machine translation system was presented at the 6th Workshop on Asian Translation (WAT-2019) |
| Approach: | They describe a NICT-2 neural machine translation system at the 6th Workshop on Asian Translation . they employ a long warm-up strategy and a self-training strategy that uses multiple back-translations generated by sampling to improve the translation quality. |
| Outcome: | The proposed system improves translation quality and learning rate by using the long warm-up and self-training strategies. |
Recycling a Pre-trained BERT Encoder for Neural Machine Translation (D19-56)
Copied to clipboard
| Challenge: | In monolingual tasks, the number of unlearned model parameters is as huge as the number learned parameters in the BERT model. |
| Approach: | They propose to apply a pre-trained Bidirectional Encoder Representations from Transformers (BERT) model to Transformer-based neural machine translation (NMT) based on the Transformer. |
| Outcome: | The proposed model is stable and efficient in low-resource settings. |