Thesis Proposal: Diagnosing and Mitigating Semantic Interference in Script-Sharing Low-Resource Language Models: A Case Study on Square Bai Script (2026.acl-srw)
Copied to clipboard
| Challenge: | Multilingual models cover more languages than ever, yet script-sharing low-resource languages remain vulnerable to failures driven by script and dominant-language priors. |
| Approach: | They propose to diagnose semantic interference in Square Bai Script, a script-sharing low-resource language . they will compare adaptation strategies under realistic compute constraints and estimate when shared-script transfer helps or harms adaptation. |
| Outcome: | The proposed model underperforms in a script-sharing low-resource setting because Bai is low-source and because it treats visible overlap as safe transfer by default. |
Similar Papers
Can Large Language Models Translate Unseen Languages in Underrepresented Scripts? (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated impressive performance in machine translation, but struggle with unseen low-resource languages. |
| Approach: | They propose a benchmark to evaluate translation for Mongolian and Yi using linguistic resources. |
| Outcome: | The proposed model can translate Mongolian (in traditional script) and Yi with the help of linguistic resources, but is limited in its ability to handle these languages effectively. |
ScriptMix: Mixing Scripts for Low-resource Language Parsing (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing work has considered transliteration and vocabulary augmentation, but the consideration of combining the two has been lacking. |
| Approach: | They propose a multilingual pretrained language model that combines two strengths and overcomes the hurdle of combining them. |
| Outcome: | The proposed model improves POS accuracy by 14% and improves DEP LAS score by 5.6%. |
CUTE: A Multilingual Dataset for Enhancing Cross-Lingual Knowledge Transfer in Low-Resource Languages (2025.coling-main)
Copied to clipboard
| Challenge: | Existing multilingual models such as XLM-R support only approximately 100-200 languages, leaving nearly 7,000 low-resource languages untapped. |
| Approach: | They construct and open-source a dataset of four-language corpora obtained through machine translation into Chinese, Uyghur and Tibetan. |
| Outcome: | The proposed dataset includes two resource-rich languages and two low-resource languages. |
Unknown Script: Impact of Script on Cross-Lingual Transfer (2024.naacl-srw)
Copied to clipboard
| Challenge: | Existing models for high-resource languages are not available for all languages, and the vast majority of the world's languages are excluded from these models. |
| Approach: | They propose to use pre-trained models to analyze the effect of the target language and its script on cross-lingual transfer. |
| Outcome: | The proposed model is based on six models pre-trained on NER and POS tasks in the original script and romanized version. |
Distantly Supervised Contrastive Learning for Low-Resource Scripting Language Summarization (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for code summarization are limited in resources and require atomic commands and category constraints to enhance code representations. |
| Approach: | They propose a framework that leverages limited atomic commands and category constraints to enhance code representations. |
| Outcome: | The proposed framework outperforms baseline methods in a number of domains and demonstrates superiority over competing frameworks. |
On Negative Interference in Multilingual Models: Findings and A Meta-Learning Treatment (2020.emnlp-main)
Copied to clipboard
| Challenge: | Modern multilingual models are trained on concatenated text from multiple languages in hopes of conferring benefits to each (positive transfer) however, recent work has shown that this approach can degrade performance on high-resource languages, a phenomenon known as negative interference. |
| Approach: | They propose a meta-learning algorithm that adds language-specific parameters as meta-parameters and trains them in a manner that explicitly improves shared layers’ generalization on all languages. |
| Outcome: | The proposed model improves cross-lingual transferability and generalization on all languages, and improves on the language-specific parameters. |
Script Normalization for Unconventional Writing of Under-Resourced Languages in Bilingual Communities (2023.acl-long)
Copied to clipboard
| Challenge: | linguistically under-represented communities have an extraordinary opportunity to create content in their native languages. |
| Approach: | They propose to solve the problem of script normalization for languages written in a Perso-Arabic script and use a transformer-based model to analyze the noise levels. |
| Outcome: | The proposed model can normalize a language written in a Perso-Arabic script and improve machine translation and language identification tasks. |
Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018) (L18-1)
Copied to clipboard
| Challenge: | null |
| Approach: | null |
| Outcome: | null |
Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019) (D19-61)
Copied to clipboard
| Challenge: | EMNLP-IJCNLP 2019 Workshop on Deep Learning Approaches for Low-Resource Natural Language Processing takes place in Hong Kong, China . |
| Approach: | EMNLP-IJCNLP 2019 Workshop on Deep Learning Approaches for Low-Resource Natural Language Processing takes place in Hong Kong, China . call for papers for this second workshop met with a strong response . |
| Outcome: | the EMNLP-IJCNLP 2019 workshop on deep learning approaches for low-resource natural language processing takes place in Hong Kong, China. |
Too Late to Train, Too Early To Use? A Study on Necessity and Viability of Low-Resource Bengali LLMs (2025.coling-main)
Copied to clipboard
Tamzeed Mahfuz, Satak Kumar Dey, Ruwad Naswan, Hasnaen Adil, Khondker Salman Sayeed, Haz Sameen Shahgir
| Challenge: | a new generation of English-oriented Large Language Models significantly outperforms older LLMs on low-resource languages. |
| Approach: | They compare Bengali-oriented LLMs with open-weight and closed-source LLM models . they conclude that there is a need for a Bengali model, but lacks high-quality pretraining data . |
| Outcome: | The proposed model outperforms existing models on Bengali on low-resource languages . the results highlight biases in machine-translated datasets used for Bengali NLP tasks . |