How many words does it take to understand a low-resource language? (2025.naacl-srw)
Copied to clipboard
| Challenge: | We evaluated the documentation needed to create a sentence embedding space using widely spoken languages. |
| Approach: | They propose to use widely spoken languages as a proxy for low-resource languages to evaluate the documentation needed to create a sentence embedding space. |
| Outcome: | The proposed language model can be used to improve the performance of sentences embedded in low-resource languages. |
Similar Papers
Few-Shot Learning Translation from New Languages (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent work shows strong transfer learning capability to unseen languages in sequence-to-sequence neural networks . current transfer learning methods require much less downstream task data than would otherwise be required. |
| Approach: | They first train word embeddings models on varying amounts of data and plug them into a machine translation model. |
| Outcome: | The proposed model can learn Flores with only 500 parallel sentences and 31,250 sentences of monolingual data, and it can exceed 15 BLEU on unseen languages. |
A Very Low Resource Language Speech Corpus for Computational Language Documentation Experiments (L18-1)
Copied to clipboard
Pierre Godard, Gilles Adda, Martine Adda-Decker, Juan Benjumea, Laurent Besacier, Jamison Cooper-Leavitt, Guy-Noel Kouarata, Lori Lamel, Hélène Maynard, Markus Mueller, Annie Rialland, Sebastian Stueker, François Yvon, Marcely Zanon-Boito
| Challenge: | a new study aims to document endangered languages using a speech corpus . linguistic documentation is limited to the phonetic, lexical and syntactic levels . |
| Approach: | They propose to use a speech corpus to document endangered languages in field . they propose to collect 5k speech utterances aligned to French text translations . |
| Outcome: | The proposed language corpus is used to document endangered languages in field linguists . it is multilingual and contains 5k speech utterances aligned to french text translations - the authors show it can be used in a zero-resource task . |
A systematic comparison of methods for low-resource dependency parsing on genuinely low-resource languages (D19-1)
Copied to clipboard
| Challenge: | Large annotated treebanks are available for only a tiny fraction of the world's languages, and there is a wealth of literature on strategies for parsing with few resources. |
| Approach: | They propose three strategies for improving low-resource parsers: data augmentation, cross-lingual training, and transliteration. |
| Outcome: | The proposed methods improve low-resource parsers by using data augmentation, cross-lingual training, and transliteration. |
JW300: A Wide-Coverage Parallel Corpus for Low-Resource Languages (P19-1)
Copied to clipboard
| Challenge: | a shortage of parallel data in low-resource languages creates a bottleneck for cross-lingual transfer . a massive collection of parallel texts for over 300 diverse languages is our main contribution . |
| Approach: | They propose a parallel corpus of over 300 languages with 100 thousand parallel sentences per language pair on average. |
| Outcome: | The proposed dataset can be used to build cross-lingual word embeddings and multi-source part-of-speech projections. |
UniBridge: A Unified Approach to Cross-Lingual Transfer Learning for Low-Resource Languages (2024.acl-long)
Copied to clipboard
| Challenge: | Existing pre-trained language models are weak in addressing cross-lingual transfer tasks. |
| Approach: | They propose a method for initializing embeddings and choosing the right vocabulary size for cross-lingual systems. |
| Outcome: | The proposed method improves the F1-Score in several languages . |
A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios (2021.naacl-main)
Copied to clipboard
| Challenge: | a growing body of work is focused on improving performance in low-resource settings . a goal of this study is to explain how these methods differ in their requirements . |
| Approach: | They propose to analyze data-lean scenarios across different dimensions of data availability to understand which approaches are effective in a specific low-resource setting. |
| Outcome: | The proposed methods enable learning when training data is sparse. |
Small Data, Big Impact: Leveraging Minimal Data for Effective Machine Translation (2023.acl-long)
Copied to clipboard
Jean Maillard, Cynthia Gao, Elahe Kalbassi, Kaushik Ram Sadagopan, Vedanuj Goswami, Philipp Koehn, Angela Fan, Francisco Guzman
| Challenge: | Existing datasets are not economical to create large-scale datasets, but for low-resource languages, a few thousand professionally translated sentence pairs can be useful. |
| Approach: | They propose to use a dataset to train machine translation models on pre-existing and synthetic data to augment them with millions of sentences through backtranslation. |
| Outcome: | The proposed model can cover hundreds of languages with high quality training data even when smaller but lower quality datasets are used. |
Predicting Embedding Reliability in Low-Resource Settings Using Corpus Similarity Measures (2022.lrec-1)
Copied to clipboard
| Challenge: | a paper aims to evaluate embedding similarity, stability and reliability in low-resource settings . it uses corpus similarity measures before training to predict properties of embeddables . |
| Approach: | They use corpus similarity measures before training to predict properties of embeddings . they then apply the same measures to low-resource settings by modelling reliability . authors hope to use this method to evaluate low-source languages with limited corpus size . |
| Outcome: | The paper shows that it is possible to predict downstream embedding similarity using upstream corpus similarity measures . the main finding is that the measures remain robust on small amounts of training data . |
Low Resource Sequence Tagging using Sentence Reconstruction (2020.acl-main)
Copied to clipboard
| Challenge: | This work revisits the task of training sequence tagging models with limited resources using transfer learning. |
| Approach: | They propose a new loss that relies on sentence reconstruction from normalized embeddings. |
| Outcome: | The proposed method achieves 0.6 F1 score on Dutch datasets using only one sample. |
Enhancing Cross-lingual Sentence Embedding for Low-resource Languages with Word Alignment (2024.findings-naacl)
Copied to clipboard
| Challenge: | Current approaches to obtain cross-lingual sentence embeddings rely on pre-trained language models that implicitly align the contextual representations of similar units of sentences in different languages. |
| Approach: | They propose a framework that explicitly aligns words between English and eight low-resource languages by using off-the-shelf word alignment models. |
| Outcome: | The proposed framework improves on the bitext retrieval task and in high-resource languages. |