Papers by Tomoki Hayashi
ESPnet-ST: All-in-One Speech Translation Toolkit (2020.acl-demos)
Copied to clipboard
Hirofumi Inaguma, Shun Kiyono, Kevin Duh, Shigeki Karita, Nelson Yalta, Tomoki Hayashi, Shinji Watanabe
| Challenge: | ESPnet-ST is a new project for the quick development of speech-to-speech translation systems. |
| Approach: | They propose a framework for rapid development of speech-to-speech translation systems . they provide all-in-one recipes including data pre-processing, feature extraction, training, and decoding pipelines . |
| Outcome: | The proposed model outperforms the current state-of-the-art models on a wide range of benchmark datasets. |
ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit (2023.acl-demo)
Copied to clipboard
Brian Yan, Jiatong Shi, Yun Tang, Hirofumi Inaguma, Yifan Peng, Siddharth Dalmia, Peter Polák, Patrick Fernandes, Dan Berrebbi, Tomoki Hayashi, Xiaohui Zhang, Zhaoheng Ni, Moto Hira, Soumi Maiti, Juan Pino, Shinji Watanabe
| Challenge: | ESPnet-ST-v2 is a revamp of the open-source spoken language translation toolkit . it supports offline speech-to-text translation (ST), simultaneous speech- to-text (SST), and offline speech to-speech (S2ST) |
| Approach: | They propose to revamp the open-source ESPnet-ST toolkit to support offline speech-to-text translation, simultaneous speech- to-text and offline speech to-speech translation. |
| Outcome: | The updated version of ESPnet-ST supports offline speech-to-text translation (ST), simultaneous speech- to-text (SST), and offline speech to-speech translation (S2ST). |