Detecting Urgency Status of Crisis Tweets: A Transfer Learning Approach for Low Resource Languages (2020.coling-main)
Copied to clipboard
| Challenge: | We train monolingual and cross-lingual classifiers on the extracted features of tweets . we use a few state-of-the-art contextual embeddings to extract features of the tweets. |
| Approach: | They propose to use tweets to train a dataset of English and two low-resource languages to train zero-shot transfer models. |
| Outcome: | The proposed model performs well in English and in low-resource languages . the proposed model is based on state-of-the-art embeddings and semi-supervised methods . |
Similar Papers
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning (2022.coling-1)
Copied to clipboard
Kunbo Ding, Weijie Liu, Yuejian Fang, Weiquan Mao, Zhe Zhao, Tao Zhu, Haoyan Liu, Rong Tian, Yiren Chen
| Challenge: | Existing zero-shot cross-lingual transfer methods rely on parallel corpora or bilingual dictionaries . however, its effect is limited by the gap between embedding clusters of different languages . |
| Approach: | They propose Embedding-Push, Attention-Pull, and Robust targets to transfer English embeddings to virtual multilingual embedders without semantic loss. |
| Outcome: | Experimental results show that the proposed method outperforms existing methods on cross-lingual tasks and can achieve a better multilingual alignment. |
Unifying Cross-Lingual Transfer across Scenarios of Resource Scarcity (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to deal with resource scarcity have not been developed to deal effectively with the problem. |
| Approach: | They propose to use a set of tools to harness data from one or more high-resource "source" languages to compensate for a shortage of data in low-resourced "target" languages. |
| Outcome: | The proposed technique can be easily adapted to unseen languages, extending the range of the proposed technique and translation-based transfer more broadly. |
NeighXLM: Enhancing Cross-Lingual Transfer in Low-Resource Languages via Neighbor-Augmented Contrastive Pretraining (2025.findings-emnlp)
Copied to clipboard
| Challenge: | NeighXLM is a neighbor-augmented contrastive pretraining framework . it exploits intra-language semantic relationships captured during pretraining to construct high-quality positive pairs. |
| Approach: | They propose a neighbor-augmented contrastive pretraining framework that mines semantic neighbors from unlabeled corpora to enrich target-language supervision. |
| Outcome: | The proposed framework enriches target-language supervision by mining semantic neighbors from unlabeled corpora. |
CUTE: A Multilingual Dataset for Enhancing Cross-Lingual Knowledge Transfer in Low-Resource Languages (2025.coling-main)
Copied to clipboard
| Challenge: | Existing multilingual models such as XLM-R support only approximately 100-200 languages, leaving nearly 7,000 low-resource languages untapped. |
| Approach: | They construct and open-source a dataset of four-language corpora obtained through machine translation into Chinese, Uyghur and Tibetan. |
| Outcome: | The proposed dataset includes two resource-rich languages and two low-resource languages. |
Make the Best of Cross-lingual Transfer: Evidence from POS Tagging with over 100 Languages (2022.acl-long)
Copied to clipboard
| Challenge: | Existing studies on cross-lingual generalisability of large pre-trained models use English training data and test data in unseen languages. |
| Approach: | They propose to use multilingual pre-trained models to model cross-lingual transfer in a selection of target languages. |
| Outcome: | The proposed model can be used to improve cross-lingual transfer performance in low-resource languages with no labeled training data. |
Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog (N19-1)
Copied to clipboard
| Challenge: | a lack of multilingual training data has hindered development of conversational AI models for task-oriented tasks . a new data set of 57k annotated utterances in english, spanish, and Thai is used to evaluate cross-lingual methods . |
| Approach: | They present a data set of 57k annotated utterances in English, Spanish and Thai . they evaluate three different cross-lingual transfer methods to identify user intents and slots . |
| Outcome: | The proposed model outperforms existing methods in English, Spanish and Thai . the proposed model is based on training data from three languages . |
Multilingual Auxiliary Tasks Training: Bridging the Gap between Languages for Zero-Shot Transfer of Hate Speech Detection Models (2022.findings-aacl)
Copied to clipboard
| Challenge: | Zero-shot cross-lingual transfer learning has been shown to be challenging for tasks involving a lot of linguistic specificities or when a cultural gap is present between languages, such as hate speech detection. |
| Approach: | They propose to train on multilingual auxiliary tasks to improve zero-shot transfer of hate speech detection models across languages by bringing a cross-lingual knowledge proxy to the task. |
| Outcome: | The proposed methods improve zero-shot transfer of hate speech detection models across languages and domains using multilingual auxiliary tasks fine-tuned. |
Low-resource Cross-lingual Event Type Detection via Distant Supervision with Minimal Effort (C18-1)
Copied to clipboard
| Challenge: | Currently, few or no language processing tools or resources exist for most languages . a problem is that there is not enough available training data even in resource-rich languages if the task is complex. |
| Approach: | They propose to use a bilingual dictionary to train machine learning in a resource-poor language . they also explore adversarial training of bilingual word representations . |
| Outcome: | The proposed approach gives similar performance in event-type detection tasks. |
Cross-lingual Few-Shot Learning on Unseen Languages (2022.aacl-main)
Copied to clipboard
| Challenge: | Large pre-trained language models have demonstrated the ability to obtain good performance on downstream tasks with limited examples in resource-rich languages. |
| Approach: | They propose to use a downstream sentiment analysis task to analyze the effectiveness of several few-shot learning strategies across 12 languages, including 8 unseen languages, to compare results. |
| Outcome: | The proposed model, XLM-R, gives the best performance on a task with few examples in resource-rich languages. |
T3L: Translate-and-Test Transfer Learning for Cross-Lingual Text Classification (2023.tacl-1)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual text classification leverage text classifiers trained in a high-resource language to perform text classification in other languages with no or minimal fine-tuning. |
| Approach: | They propose to combine a neural machine translator and a text classifier trained in a high-resource language to perform text classification in other languages with no or minimal fine-tuning. |
| Outcome: | The proposed approach significantly improves over a baseline approach. |