Improving Zero-Shot Cross-lingual Transfer for Multilingual Question Answering over Knowledge Graph (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to solve multilingual question answering over knowledge graph (KGQA) use of bilingual lexicon induction to map training questions into those in target language circumvents language inconsistency . |
| Approach: | They propose to use bilingual lexicon induction to map training questions in source and target languages as augmented training data to minimize syntax-disorder. |
| Outcome: | The proposed model narrows the gap in zero-shot cross-lingual transfer between source and target languages. |
Similar Papers
A System for Answering Simple Questions in Multiple Languages (2023.acl-demo)
Copied to clipboard
| Challenge: | Existing knowledge graph question answering systems are limited to simple questions, but they can be used to answer complex questions. |
| Approach: | They propose a multilingual Knowledge Graph Question Answering technique that orders potential responses based on the distance between the question’s text embeddings and the answer’s graph embedds. |
| Outcome: | The proposed method consistently outperforms baseline systems, including seq2seq QA models and complex rule-based pipelines. |
Analyzing the Evaluation of Cross-Lingual Knowledge Transfer in Multilingual Language Models (2024.eacl-long)
Copied to clipboard
| Challenge: | Recent advances in training multilingual models on large datasets have shown promising results in knowledge transfer across languages. |
| Approach: | They challenge the assumption that high zero-shot performance reflects high cross-lingual ability by introducing more challenging setups involving instances with multiple languages. |
| Outcome: | The proposed model can achieve high performance on multilingual benchmarks and on low-resource languages. |
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning (2022.coling-1)
Copied to clipboard
Kunbo Ding, Weijie Liu, Yuejian Fang, Weiquan Mao, Zhe Zhao, Tao Zhu, Haoyan Liu, Rong Tian, Yiren Chen
| Challenge: | Existing zero-shot cross-lingual transfer methods rely on parallel corpora or bilingual dictionaries . however, its effect is limited by the gap between embedding clusters of different languages . |
| Approach: | They propose Embedding-Push, Attention-Pull, and Robust targets to transfer English embeddings to virtual multilingual embedders without semantic loss. |
| Outcome: | Experimental results show that the proposed method outperforms existing methods on cross-lingual tasks and can achieve a better multilingual alignment. |
Cross-Lingual Knowledge Projection and Knowledge Enhancement for Zero-Shot Question Answering in Low-Resource Languages (2025.coling-main)
Copied to clipboard
| Challenge: | Knowledge bases (KBs) in low-resource languages are often incomplete, restricting the ability to do zero-shot question answering using multilingual language models. |
| Approach: | They propose a novel cross-lingual mapping technique which improves word alignments extracted from parallel English-LRL text by combining lexical alignment, named entity recognition, and semantic alignment. |
| Outcome: | The proposed approach improves zero-shot question answering accuracy by up to 17% compared to baselines without KB access. |
CrossAligner & Co: Zero-Shot Transfer Methods for Task-Oriented Cross-lingual Natural Language Understanding (2022.findings-acl)
Copied to clipboard
| Challenge: | Task-oriented personal assistants enable people to interact with devices and services using natural language. |
| Approach: | They propose a method to acquire task knowledge in a high-resource language and then transfer it to the low-resourced language(s) they use unlabelled parallel data to perform a quantitative analysis of the methods. |
| Outcome: | The proposed methods exceed state-of-the-art (SOTA) scores across nine languages, fifteen test sets and three benchmark multilingual datasets. |
Zero-Shot Cross-Lingual Transfer with Meta Learning (2020.emnlp-main)
Copied to clipboard
| Challenge: | There are more than 7,000 languages spoken in the world, over 90 of which have more than 10 million native speakers each. |
| Approach: | They propose to use meta-learning to train a model on multiple languages at the same time . they use standard supervised, zero-shot cross-lingual, and few-shot crosses-lingual settings for different natural language understanding tasks. |
| Outcome: | The proposed setup improves on the state-of-the-art for a total of 15 languages. |
Multilingual Verbalisation of Knowledge Graphs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Most work on Knowledge Graph (KG) verbalisation is monolingual leaving open the question of how to scale KG-to-Text generation to languages with varying amounts of resources. |
| Approach: | They explore how to scale KG-to-Text generation to languages with varying resources . they construct multilingual training data and test data for each language . |
| Outcome: | The proposed approach performs best on all 9 languages, compared with other approaches on low vs high resource languages and on in- v. out-of-domain data. |
Cross-lingual Structure Transfer for Zero-resource Event Extraction (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing approaches for information extraction only use name tagging . Currently, most successful cross-lingual transfer learning methods are limited to sequence labeling . |
| Approach: | They propose a share-and-transfer framework to transfer graph structures across languages . they propose to convert sentences in any language to language-universal graph structures . |
| Outcome: | The proposed framework performs comparable to state-of-the-art models on three languages without annotations. |
Towards Zero-Shot Multilingual Transfer for Code-Switched Responses (2023.acl-long)
Copied to clipboard
| Challenge: | Recent task-oriented dialog systems have had great success building English-based personal assistants, but extending these systems to a global audience may take tremendous efforts. |
| Approach: | They propose a framework that allows for efficient transfer by learning task-specific representations and encapsulating source and target language representations. |
| Outcome: | The proposed framework is able to successfully transfer language knowledge even when the target language corpus is limited. |
Key ingredients for effective zero-shot cross-lingual knowledge transfer in generative tasks (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing studies have focused on zero-shot cross-lingual transfer . mBERT, mBART and mT5 provide high-quality representations for texts in various languages . |
| Approach: | They propose to use mBART and NLLB-200 to finetune a multilingual pretrained language model on input-output pairs in one language and use it to make task predictions for inputs in other languages. |
| Outcome: | The proposed approach significantly reduces generation in the wrong language with full finetuning and can be competitive in some cases. |