Papers by Tosho Hirasawa
Zero-shot North Korean to English Neural Machine Translation by Character Tokenization and Phoneme Decomposition (2020.acl-srw)
Copied to clipboard
| Challenge: | a limited number of North Korean to English translation models have been developed . a zero-shot approach is proposed to train a neural machine translation model using South Korean data . |
| Approach: | They propose a method to tokenize South Korean input sentences and decompose them into phonemes. |
| Outcome: | The proposed method improves the BLEU scores by +1.01 points compared with the baseline . the proposed method can learn North Korean to English translation and improve the linguistic accuracy. |
Construction of a Quality Estimation Dataset for Automatic Evaluation of Japanese Grammatical Error Correction (2022.lrec-1)
Copied to clipboard
Daisuke Suzuki, Yujin Takahashi, Ikumi Yamashita, Taichi Aida, Tosho Hirasawa, Michitaka Nakatsuji, Masato Mita, Mamoru Komachi
| Challenge: | Existing studies on automatic evaluation of grammatical error correction (GEC) have shown that quality estimation models built from manual evaluation can achieve high performance in automatic evaluation in English. |
| Approach: | They used a dataset with manual evaluation to build an automatic evaluation model for Japanese GEC. |
| Outcome: | The proposed model is based on a Japanese dataset with manual evaluation and meta-evaluation. |
Multimodal Machine Translation with Embedding Prediction (N19-3)
Copied to clipboard
| Challenge: | Pretrained word embeddings improve multimodal machine translation of low-resource domains due to a shortage of training data. |
| Approach: | They propose to combine pretrained word embeddings with search-based approaches to improve NMT of low-resource domains to better translate rare words. |
| Outcome: | The proposed approach improves translation performance by 1.24 METEOR and 2.49 BLEU and achieves 7.67 F-score. |
Pruning Multilingual Large Language Models for Multilingual Inference (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Multilingual large language models (MLLMs) demonstrate better zeroshot learning performance in non-English languages compared to large language model trained on English-dominant data. |
| Approach: | They propose a pruning approach to prune large language models using bilingual sentence pairs from English and other languages to enhance their performance in non-English language. |
| Outcome: | The proposed pruning strategy enhances the MLLMs’ performance in non-English language. |
Sentence Concatenation Approach to Data Augmentation for Neural Machine Translation (2021.naacl-srw)
Copied to clipboard
| Challenge: | Neural machine translation is known to show poor performance at long sentence translations . however, when the sentence length exceeds a certain value, the quality of NMT becomes inferior to that of statistical machine translation. |
| Approach: | They propose a method that uses given parallel corpora as train data to generate long sentences by concatenating two sentences at random. |
| Outcome: | The proposed method improves translation quality more when combined with back-translation. |
Does Masked Language Model Pre-training with Artificial Data Improve Low-resource Neural Machine Translation? (2023.findings-eacl)
Copied to clipboard
| Challenge: | Pre-training masked language models with artificial data has been proven beneficial for several natural language processing tasks, however, it has been less explored for neural machine translation (NMT). |
| Approach: | They pre-trained masked language models with random sequences and created artificial data mimicking token frequency information from the real world. |
| Outcome: | The results show that pre-training models with artificial data improves translation performance in low-resource situations. |