Challenge: Recent work on multilingual language models has demonstrated their capacity for cross-lingual zero-shot transfer on downstream tasks.
Approach: They conduct a large-scale empirical study to isolate the effects of various linguistic properties by measuring zero-shot transfer between four different natural languages.
Outcome: The proposed model exhibits decent cross-lingual zero-shot transfer, with no significant differences in word order and embedding alignment.

Similar Papers

A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning (2022.coling-1)

Copied to clipboard

Challenge: Existing zero-shot cross-lingual transfer methods rely on parallel corpora or bilingual dictionaries . however, its effect is limited by the gap between embedding clusters of different languages .
Approach: They propose Embedding-Push, Attention-Pull, and Robust targets to transfer English embeddings to virtual multilingual embedders without semantic loss.
Outcome: Experimental results show that the proposed method outperforms existing methods on cross-lingual tasks and can achieve a better multilingual alignment.
Analyzing the Evaluation of Cross-Lingual Knowledge Transfer in Multilingual Language Models (2024.eacl-long)

Copied to clipboard

Challenge: Recent advances in training multilingual models on large datasets have shown promising results in knowledge transfer across languages.
Approach: They challenge the assumption that high zero-shot performance reflects high cross-lingual ability by introducing more challenging setups involving instances with multiple languages.
Outcome: The proposed model can achieve high performance on multilingual benchmarks and on low-resource languages.
How Multilingual is Multilingual BERT? (P19-1)

Copied to clipboard

Challenge: Existing studies have shown that deep, contextualized language models can encode syntactic and named entity information, but they have focused on what models trained on English capture about English.
Approach: They propose a multilingual model pre-trained from monolingual Wikipedia corpora . they show that multilingual BERT is surprisingly good at zero-shot cross-lingual model transfer .
Outcome: The proposed model can find translation pairs, but it exhibits systematic deficiencies affecting certain language pairs.
Can Monolingual Pretrained Models Help Cross-Lingual Classification? (2020.aacl-main)

Copied to clipboard

Challenge: Multilingual pretrained language models have shown impressive results for cross-lingual transfer, but due to the constant model capacity, multilingual pre-training usually lags behind the monolingual competitors.
Approach: They propose to transfer the knowledge from monolingual pretrained models to multilingual ones to improve zero-shot cross-lingual classification by using machine translation systems.
Outcome: The proposed methods outperform vanilla multilingual fine-tuning on two cross-lingual classification benchmarks.
Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer? (2022.emnlp-main)

Copied to clipboard

Challenge: Multilingual BERT (mBERT) has demonstrated considerable cross-lingual syntactic ability, but it is not well understood what leads to this variation and whether it fairly reflects difference between languages.
Approach: They propose to use multilingual BERT to enable zero-shot cross-lingual transfer of syntactic knowledge between different languages by generating grammatical relations in 24 different languages.
Outcome: The results show that the distance between the distributions of different languages is highly consistent with the syntactic difference in terms of linguistic formalisms.
First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT (2021.eacl-main)

Copied to clipboard

Challenge: Multilingual pretrained language models have demonstrated remarkable zero-shot cross-lingual transfer capabilities.
Approach: They propose to use a layer ablation technique to create a multilingual model that is viewed as a stacking of two sub-networks: a language-agnostic encoder and a task-specific predictor.
Outcome: The proposed model can perform zero-shot cross-lingual transfer for many languages.
A Massively Multilingual Analysis of Cross-linguality in Shared Embedding Space (2021.emnlp-main)

Copied to clipboard

Challenge: Cross-lingual language models house representations for many different languages in the same space.
Approach: They investigate linguistic and non-linguistic factors affecting sentence-level alignment in cross-lingual pretrained language models for 101 languages and 5,050 language pairs.
Outcome: The results show that word order agreement and agreement in morphological complexity are strongest predictors of cross-linguality.
Identifying Elements Essential for BERT’s Multilinguality (2020.emnlp-main)

Copied to clipboard

Challenge: Multilingual BERT (mBERT) does not use any crosslingual signal during training.
Approach: They propose a multilingual pretraining setup that modifies the masking strategy using VecMap to allow for fast experimentation.
Outcome: The proposed setup with pretrained models with three languages shows that it works well.
Multilinguality Does not Make Sense: Investigating Factors Behind Zero-Shot Cross-Lingual Transfer in Sense-Aware Tasks (2025.emnlp-main)

Copied to clipboard

Challenge: Cross-lingual transfer allows models to perform tasks in languages unseen during training and is often assumed to benefit from increased multilinguality.
Approach: They challenge this assumption by analyzing polysemy disambiguation and lexical semantic change in 28 languages and using confounding factors to account for perceived advantages.
Outcome: The proposed models and benchmarks are compared across 28 languages and show that multilingual training is neither necessary nor beneficial for effective transfer.
On the Cross-lingual Transferability of Monolingual Representations (2020.acl-main)

Copied to clipboard

Challenge: State-of-the-art unsupervised multilingual models generalize in zero-shot cross-lingual setting . generalization ability attributed to shared subword vocabulary and joint training across multiple languages .
Approach: They propose an approach that transfers a monolingual model to new languages at the lexical level.
Outcome: The proposed approach is competitive with multilingual BERT on cross-lingual classification benchmarks and on a new cross-linguistic question answering dataset.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations