Anchor-based Bilingual Word Embeddings for Low-Resource Languages (2021.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to build monolingual word embeddings rely on a cheap bilingual signal and monolingual data. |
| Approach: | They propose a method where the vector space of the high resource source language is used as a starting point for training an embedding space for the low resource target language. |
| Outcome: | The proposed approach improves bilingual lexicon induction performance and target language MWE quality. |
Similar Papers
Enhancing Cross-lingual Sentence Embedding for Low-resource Languages with Word Alignment (2024.findings-naacl)
Copied to clipboard
| Challenge: | Current approaches to obtain cross-lingual sentence embeddings rely on pre-trained language models that implicitly align the contextual representations of similar units of sentences in different languages. |
| Approach: | They propose a framework that explicitly aligns words between English and eight low-resource languages by using off-the-shelf word alignment models. |
| Outcome: | The proposed framework improves on the bitext retrieval task and in high-resource languages. |
Unsupervised Multilingual Word Embedding with Limited Resources using Neural Language Models (P19-1)
Copied to clipboard
| Challenge: | Existing methods that map word embeddings into a common space without any parallel data or pre-training have been proposed that are limited in resources and perform poorly under resource-poor conditions. |
| Approach: | They propose a model that maps monolingual word embeddings into a common space without any parallel data and generates multilingual embeddables without any pre-training. |
| Outcome: | The proposed model outperforms existing methods on word alignment tasks on low-resource conditions and with limited resources. |
Supervised and Nonlinear Alignment of Two Embedding Spaces for Dictionary Induction in Low Resourced Languages (D19-1)
Copied to clipboard
| Challenge: | Existing methods for mapping monolingual word embeddings into another are based on anchor points and unsupervised methods are more adversarial. |
| Approach: | They propose a noise-tolerant piecewise linear technique to learn a non-linear mapping between two monolingual word embedding vector spaces. |
| Outcome: | The proposed method outperforms the state-of-the-art in lower resourced settings with an average of 3.7% improvement of precision @10 across 14 mostly low resourced languages. |
Beyond Offline Mapping: Learning Cross-lingual Word Embeddings through Context Anchoring (2021.acl-long)
Copied to clipboard
| Challenge: | Recent research on cross-lingual word embeddings has been dominated by unsupervised mapping approaches that align monolingual embedders. |
| Approach: | They propose an unsupervised mapping approach that fixes fixed embeddings and learns new ones for the source language that are aligned with them. |
| Outcome: | The proposed method outperforms conventional mapping methods on bilingual lexicon induction and obtains competitive results in the downstream XNLI task. |
Combining Word Embeddings with Bilingual Orthography Embeddings for Bilingual Dictionary Induction (2020.coling-main)
Copied to clipboard
| Challenge: | Bilingual dictionary induction (BDI) is a task of finding target language translations of source language words. |
| Approach: | They propose to use bilingual orthography Embeddings to enrich BWE-based BDI with transliteration information to make a decision on which information source is more reliable for a particular word pair. |
| Outcome: | The proposed system improves on English-Russian BDI and shows that it can be built with only weak bilingual signals and even without any bilingual signal. |
Cross-Lingual Word Embeddings for Turkic Languages (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing techniques to align monolingual embeddings are difficult to use because of low resources. |
| Approach: | They propose to use existing techniques to align monolingual embedding spaces for Turkic, Uzbek, Azeri, Kazakh and Kyrgyz languages. |
| Outcome: | The proposed techniques outperform existing techniques on bilingual dictionaries and an extrinsic task. |
A Simple Approach to Learning Unsupervised Multilingual Embeddings (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent work on unsupervised cross-lingual embeddings in the bilingual setting has given the impetus to learning a shared embeddable space for several languages. |
| Approach: | They propose to solve two sub-problems together to learn a shared embedding space for several languages. |
| Outcome: | The proposed approach outperforms existing methods in bilingual lexicon induction, cross-lingual word similarity, multilingual document classification, and multilingual dependency parsing tasks. |
Evaluating Sub-word Embeddings in Cross-lingual Models (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing approaches to learning sub-word embeddings for out-of-vocabulary words have not considered sub- word embedds in cross-lingual models. |
| Approach: | They propose to use sub-word embeddings to form cross-lingual embeddables for out-of-vocabulary (OOV) words for which no embeddibles are available. |
| Outcome: | The proposed bilingual lexicon induction task shows that sub-word embeddings can be leveraged to form cross-lingual embeddables for OOV words. |
Exploring Bilingual Word Embeddings for Hiligaynon, a Low-Resource Language (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing studies on Hiligaynon, a low-resource language of Malayo-Polynesian origin, have not explored the use of bilingual word embeddings in NLP. |
| Approach: | They use a publicly available Hiligaynon corpus with only 300K words to match it with a comparable English corpus. |
| Outcome: | The proposed model outperforms results from a low-resource language of Malayo-Polynesian origin with over 9 million speakers in the Philippines. |
Unsupervised Joint Training of Bilingual Word Embeddings (P19-1)
Copied to clipboard
| Challenge: | Existing methods for unsupervised bilingual word embeddings are limited by the dissimilarity between the word embedded spaces. |
| Approach: | They propose a method that trains unsupervised bilingual word embeddings jointly on parallel data generated through unsupervised machine translation. |
| Outcome: | The proposed method outperforms unsupervised mapped bilingual word embeddings in cross-lingual NLP tasks. |