Papers with XEUS
Towards Robust Speech Representation Learning for Thousands of Languages (2024.emnlp-main)
Copied to clipboard
William Chen, Wangyou Zhang, Yifan Peng, Xinjian Li, Jinchuan Tian, Jiatong Shi, Xuankai Chang, Soumi Maiti, Karen Livescu, Shinji Watanabe
| Challenge: | XEUS is a cross-lingual encoder for universal speech that can be trained on 1 million hours of data across 4057 languages. |
| Approach: | They propose a Cross-lingual Encoder for Universal Speech that can be trained on 1 million hours of data across 4057 languages and a newly created corpus of 7400+ hours from 4057 . |
| Outcome: | The proposed model outperforms state-of-the-art models on several benchmarks and outperfies MMS 1B and w2v-BERT 2.0 v2 by 0.8% and 4.4% respectively. |