| Challenge: | This paper provides language identification models for low- and under-resourced languages in the Pacific region with a focus on previously unavailable Austronesian languages. |
| Approach: | They compare a classifier based on skip-gram embeddings with other methods . they then increase the number of non-Austronesian languages to 800 to evaluate their performance . |
| Outcome: | The proposed model improves on the previous methods for low- and under-resourced languages in the Pacific region. |
Similar Papers
One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia (2022.acl-long)
Copied to clipboard
Alham Fikri Aji, Genta Indra Winata, Fajri Koto, Samuel Cahyawijaya, Ade Romadhony, Rahmad Mahendra, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Timothy Baldwin, Jey Han Lau, Sebastian Ruder
| Challenge: | There are more than 700 languages spoken in Indonesia, equal to 10% of the world's languages, second only to Papua New Guinea. |
| Approach: | They focus on the languages spoken in Indonesia, the world's second most linguistically diverse nation, and the fourth most populous nation of the world. |
| Outcome: | The proposed model is based on the languages spoken in Indonesia, the world's second-most linguistically diverse nation, with 273 million people spread over 17,508 islands. |
FormosanBench: Benchmarking Low-Resource Austronesian Languages in the Era of Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing LLMs consistently underperform across all tasks, with 10-shot learning and fine-tuning offering only limited improvements. |
| Approach: | They introduce FormosanBench, a benchmark for evaluating LLMs on low-resource Austronesian languages. |
| Outcome: | The proposed benchmark covers three endangered Formosan languages: Atayal, Amis, and Paiwan . existing LLMs consistently underperform across all tasks, with 10-shot learning and fine-tuning offering only limited improvements. |
GlotLID: Language Identification for Low-Resource Languages (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing web-mined datasets for low-resource languages have been useful for low resource NLP. |
| Approach: | They propose a model that identifies 1665 low-resource languages and a new model that is rigorously evaluated and reliable. |
| Outcome: | The proposed model outperforms baselines when balancing F1 and false positive rate (FPR). |
Identifying Open Challenges in Language Identification (2025.acl-long)
Copied to clipboard
| Challenge: | Existing work on language identification has focused on cross-domain setups, but no systematic comparison is available. |
| Approach: | They propose to train an accurate multi-domain languageidentification model on 2,034 languages and analyze the remaining errors. |
| Outcome: | The proposed model performs well on 2,034 languages with training with 1,000 instances per language and a maximum input length of 100 characters. |
A Survey of NLP Progress in Sino-Tibetan Low-Resource Languages (2025.naacl-long)
Copied to clipboard
| Challenge: | Despite the increasing effort in including more low-resource languages in NLP/CL development, most of the world’s languages are still absent. |
| Approach: | They propose to include low-resource languages in NLP/CL research as more resources are poured into the development of data-driven models. |
| Outcome: | The proposed language family is a low-resource language family with a small number of native speakers and government support. |
GeezSwitch: Language Identification in Typologically Related Low-resourced East African Languages (2022.lrec-1)
Copied to clipboard
| Challenge: | Low-resourced languages with similar typologies are often confused with each other in real-world applications such as machine translation, affecting the user’s experience. |
| Approach: | They propose to build a dataset for five typologically and phylogenetically related low-resourced East African languages using the Ge’ez script as a writing system. |
| Outcome: | The proposed dataset is built automatically from selected data sources, but also performed a manual evaluation to assess its quality. |
Geographically-Informed Language Identification (2024.lrec-main)
Copied to clipboard
| Challenge: | a paper develops a method to identify languages based on geographic origin of text . the model is based in regions where languages are widely spoken and may occur anywhere . |
| Approach: | They propose to incorporate geographic information into a language identification model to ensure coverage of linguae francae regardless of location. |
| Outcome: | The proposed model includes 31 widely-spoken international languages . the model improves on social media data and improves performance on 916 languages compared to baseline models . |
LIMIT: Language Identification, Misidentification, and Translation using Hierarchical Models in 350+ Languages (2023.emnlp-main)
Copied to clipboard
| Challenge: | Currently, existing systems cannot accurately identify most of the world's 7000 languages due to lack of data and computational challenges. |
| Approach: | They propose a misprediction-resolution hierarchical model, LIMIT, that reduces error by 55% on a children's stories dataset and by 40% on 'fLORES-200' benchmark. |
| Outcome: | The proposed model reduces error by 55% on the MCS-350 and 40% on the FLORES-200 benchmarks. |
Challenges of language technologies for the indigenous languages of the Americas (C18-1)
Copied to clipboard
| Challenge: | Indigenous languages of the American continent are highly diverse, but have received little attention from the technological perspective. |
| Approach: | They review the research, the digital resources and the available NLP systems for indigenous languages of the American continent . they stress the need of developing language resources and NLP tools for these languages . |
| Outcome: | The authors review the research and the available NLP systems on indigenous languages of the Americas . they argue that the lack of resources and tools can have a negative impact on the communities which depend on these languages . |
Exploring Cross-Lingual Voice Conversion Methods for Anonymizing Low-Resource Text-to-Speech (2026.eacl-short)
Copied to clipboard
| Challenge: | a growing number of speech synthesis systems clone a person's voice, a new study finds . a variety of voice conversion techniques can mask speaker identities in low-resource text-to-speech systems. |
| Approach: | They compare voice conversion techniques to mask speaker identities in text-to-speech systems . they build and evaluate speaker-anonymized systems for two Canadian Indigenous languages . |
| Outcome: | The proposed methods are compared with other approaches for using voice conversion to mask speaker identities in low-resource text-to-speech systems. |