PUMA: Projected Universal Multilingual ASR for Low-Resource Settings. Application to Diverse African Languages (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing multilingual ASR models fail to generalize to low-resource languages while remaining costly to scale. |
| Approach: | They propose a multilingual ASR model that integrates a learnable language token with acoustic representations to enable language-aware processing. |
| Outcome: | The proposed model improves low-resource performance with reduced model complexity on African languages. |
Similar Papers
TEMA: Token Embeddings Mapping for Enriching Low-Resource Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Low-resource languages, that is, languages that do not have a massive amount of text, risk being almost excluded from the possibility of having good NLP applications. |
| Approach: | They propose an algorithm that maps token embeddings of a richly pre-trained model to a poorly trained model and creates a more complex model. |
| Outcome: | The proposed model reduces perplexity and is competitive or better for the most semantic tasks. |
An (unhelpful) guide to selecting the best ASR architecture for your under-resourced language (2023.acl-short)
Copied to clipboard
| Challenge: | English ASR now has word error rates comparable to that of human transcriptionists, but only for the handful of the world's 7000 languages with abundant training resources. |
| Approach: | They propose to use four of the most popular ASR toolkits to train ASR models for eleven languages with limited ASR training resources: eleven widely spoken languages of Africa, Asia, and South America, one endangered language of Central America, and three critically endangered languages of North America. |
| Outcome: | The proposed architecture outperforms four of the most popular ASR toolkits for eleven languages with limited training resources. |
Adapting Where It Matters: Depth-Aware Adaptation for Efficient Multilingual Speech Recognition in Low-Resource Languages (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent speech foundation models excel at multilingual automatic speech recognition (ASR) for high-resource languages, but their performance drops substantially on low-resourced languages due to the limited data availability. |
| Approach: | They propose a Depth-Aware Model Adaptation framework that allocates adaptation capacity according to each layer’s role. |
| Outcome: | The proposed framework matches or surpasses state-of-the-art accuracy with 80% fewer trainable parameters and achieves 29% error reduction under extreme data scarcity. |
Multilingual Encoder Knows more than You Realize: Shared Weights Pretraining for Extremely Low-Resource Languages (2025.acl-long)
Copied to clipboard
| Challenge: | XLM-R and mBART have advanced multilingualism in NLP, but low-resource languages such as Tibetan, Uyghur, Kazakh, and Mongolian are underserved. |
| Approach: | They propose a framework for adapting multilingual encoders to text generation in extremely low-resource languages by reusing the weights between the encoder and the decoder. |
| Outcome: | The proposed framework performs better on various downstream tasks even when compared with much larger models. |
A Survey of Multilingual Models for Automatic Speech Recognition (2022.lrec-1)
Copied to clipboard
| Challenge: | Automatic Speech Recognition (ASR) systems have achieved human-like performance for a few languages, but the majority of the world’s languages do not have usable systems due to the lack of large speech datasets to train these models. |
| Approach: | They propose to use unlabeled speech data to build multilingual ASR models that can be used for improved performance on low-resource languages. |
| Outcome: | The proposed models can be used to improve performance on low-resource languages by using unlabeled speech data. |
Fine-Tuning ASR models for Very Low-Resource Languages: A Study on Mvskoke (2024.acl-srw)
Copied to clipboard
| Challenge: | Recent advances in multilingual models for automatic speech recognition (ASR) have been able to achieve a high accuracy for languages with extremely limited resources. |
| Approach: | They examine the parameter efficiency of training an adapter for the Mvskoke language, an indigenous language of America. |
| Outcome: | The proposed model is parameter efficient and gives higher accuracy for a relatively small amount of data. |
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts (2021.emnlp-main)
Copied to clipboard
| Challenge: | Massively multilingual language models offer state-of-the-art cross-lingual transfer performance on a range of NLP tasks, but there is a profound performance gap between resource-rich and resource-poor target languages. |
| Approach: | They propose a series of data-efficient methods that enable quick and effective adaptation of pretrained multilingual models to low-resource languages and unseen scripts. |
| Outcome: | The proposed methods improve learning of the new dedicated embedding matrix in the target language and for low-resource languages written in unseen scripts. |
Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuning (2022.coling-1)
Copied to clipboard
| Challenge: | Multilingual pre-trained language models have shown impressive performance on several downstream tasks for both high-resourced and low-resource languages. |
| Approach: | They propose to apply multilingual adaptive fine-tuning to 17 most-resourced African languages and three other high-resource languages to encourage cross-lingual transfer learning. |
| Outcome: | The proposed approach is competitive to LAFT on individual languages while requiring significantly less disk space. |
Semi-supervised Development of ASR Systems for Multilingual Code-switched Speech in Under-resourced Languages (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing models for code-switching between languages are under-resourced and limited by text and acoustic data. |
| Approach: | They propose to construct four separate bilingual automatic speech recognisers corresponding to four different language pairs between which speakers switch frequently. |
| Outcome: | The proposed models are compared with a non-batch-wise approach and show that they perform better when used with sparse training data. |
The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLP (2026.acl-long)
Copied to clipboard
Sheriff Issaka, Keyi Wang, Yinka Ajibola, Oluwatumininu Samuel-Ipaye, Zhaoyi Zhang, Nicte Aguillon Jimenez, Evans Kofi Agyei, Abraham Lin, Rohan Ramachandran, Sadick Abdul Mumin, Faith Nchifor, Mohammed Shuraim Issah, Erick Rosas Gonzalez, Lieqi Liu, Sylvester Kpei, Jemimah Kusi Osei, Carlene Ajeneza, Persis Boateng, Prisca Adwoa Dufie Yeboah, Saadia Gabriel
| Challenge: | Among the approximately 7,000 languages spoken globally, fewer than 20 receive substantial attention in NLP research. |
| Approach: | They propose to use African multi-modal speech and text data to validate African multimodal models and validate them on targeted language data. |
| Outcome: | The African Languages Lab's results show that the proposed model outperforms untrained models in 31 languages and a 1B-parameter model beats the commercial system in Yoruba and Twi. |