EntityCS: Improving Zero-Shot Cross-lingual Transfer with Entity-Centric Code Switching (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for CS use dictionaries or parallel sentences with word-alignment to generate CS data by randomly switching words in a sentence. |
| Approach: | They propose a method that focuses on Entity-level Code-Switching to capture fine-grained cross-lingual semantics without corrupting syntax. |
| Outcome: | The proposed method captures fine-grained cross-lingual semantics without corrupting syntax. |
Similar Papers
Zero-shot Cross-lingual NER via Mitigating Language Difference: An Entity-aligned Translation Perspective (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual Named Entity Recognition focus on Latin script language (LSL) for non-Latin script language, performance often degrades due to deep structural differences. |
| Approach: | They propose an entity-aligned translation approach to align entities between NSL and English . |
| Outcome: | The proposed approach aims to transfer knowledge from high-resource languages to low-resourced languages. |
Code-Switching Can be Better Aligners: Advancing Cross-Lingual SLU through Representation-Level and Prediction-Level Alignment (2024.acl-short)
Copied to clipboard
| Challenge: | Existing code-switching-based cross-lingual spoken language understanding frameworks are limited to low-resource languages. |
| Approach: | They propose a cross-lingual spoken language understanding framework that leverages both code-switched and original sentences to achieve multi-level alignment. |
| Outcome: | The proposed framework can achieve multi-level alignment on two benchmarks across ten languages. |
Investigating and Scaling up Code-Switching for Multilingual Language Model Pre-Training (2025.findings-acl)
Copied to clipboard
Zhijun Wang, Jiahuan Li, Hao Zhou, Rongxiang Weng, Jingang Wang, Xin Huang, Xue Han, Junlan Feng, Chao Deng, Shujian Huang
| Challenge: | Large language models (LLMs) exhibit remarkable multilingual capabilities despite the extreme language imbalance in the pre-training data. |
| Approach: | They investigate the existence of code-switching in the pre-training corpus and categorize it into four types within two quadrants. |
| Outcome: | The proposed approach improves performance across benchmarks and representation space. |
Code-Switched Language Identification is Harder Than You Think (2024.eacl-long)
Copied to clipboard
| Challenge: | Code switching (CS) is a common phenomenon in written and spoken communication, but is handled poorly by many NLP applications. |
| Approach: | They propose to use CS language identification for corpus building to make it more realistic by scaling it to more languages and considering models with simpler architectures for faster inference. |
| Outcome: | The proposed system is based on a sentence-level multi-label tagging problem and provides recommendations for future work. |
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning (2022.coling-1)
Copied to clipboard
Kunbo Ding, Weijie Liu, Yuejian Fang, Weiquan Mao, Zhe Zhao, Tao Zhu, Haoyan Liu, Rong Tian, Yiren Chen
| Challenge: | Existing zero-shot cross-lingual transfer methods rely on parallel corpora or bilingual dictionaries . however, its effect is limited by the gap between embedding clusters of different languages . |
| Approach: | They propose Embedding-Push, Attention-Pull, and Robust targets to transfer English embeddings to virtual multilingual embedders without semantic loss. |
| Outcome: | Experimental results show that the proposed method outperforms existing methods on cross-lingual tasks and can achieve a better multilingual alignment. |
Toward the Limitation of Code-Switching in Cross-Lingual Transfer (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have shown the success of multilingual pretrained models for cross-lingual knowledge transfer. |
| Approach: | They propose to make code-switched sentences replace tokens from multiple languages so they are grammatically consistent . they also consider the similarity between context and the switched tokens to ensure that the newly substituted sentences are grammatically consistent - a limitation that could affect inference . |
| Outcome: | The proposed method outperforms the mBERT and original code-switching method on cross-lingual POS and Named-Entity-Recognition tasks on 30+ languages. |
Cross-Lingual Transfer in Zero-Shot Cross-Language Entity Linking (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing work on cross-language entity linking grounds mentions written in multiple languages to a monolingual knowledge base is lacking. |
| Approach: | They propose a task that uses multilingual BERT representations of both the mention and context as input and explore zero-shot language transfer. |
| Outcome: | The proposed model performs well in both monolingual and multilingual settings. |
Exploiting In-Domain Bilingual Corpora for Zero-Shot Transfer Learning in NLU of Intra-Sentential Code-Switching Chatbot Interactions (2022.emnlp-industry)
Copied to clipboard
Maia Aguirre, Manex Serras, Laura García-sardiña, Jacobo López-fernández, Ariane Méndez, Arantza Del Pozo
| Challenge: | Multilingual speakers outnumber monolingual speakers in the world . CS is a frequent habit in both spoken and written informal communications . |
| Approach: | They evaluate the efficacy of cross-lingual transfer learning with mBERT for NLU on a Basque-Spanish CS chatbot corpus. |
| Outcome: | The proposed model outperforms models trained on Basque and Spanish without CS on a basque-Spanish chatbot corpus. |
El Volumen Louder Por Favor: Code-switching in Task-oriented Semantic Parsing (2021.eacl-main)
Copied to clipboard
| Challenge: | Code-switching (CS) is the alternation of languages within an utterance or conversation. |
| Approach: | They propose to use translation-and-align and augment with a generation model followed by match-and filter to improve CS generalizability of cross-lingual models when data for only one language is available. |
| Outcome: | The proposed models improve when only English data is available alongside zero or a few CS training instances. |
Code-Mixed Probes Show How Pre-Trained Models Generalise on Code-Switched Text (2024.lrec-main)
Copied to clipboard
| Challenge: | Code-switching is a prevalent linguistic phenomenon in which multilingual individuals seamlessly alternate between languages. |
| Approach: | They propose to use pre-trained language models to generalise to code-switched text . they use a dataset of well-formed naturalistic code-witched texts and parallel translations into the source languages to examine their results. |
| Outcome: | The proposed model generalises to code-switched text, shedding light on their ability to generalise representations to CS corpora. |