| Challenge: | Existing work on cross-lingual word embeddings rely on linear mappings, but this assumption is not true for all language pairs. |
| Approach: | They propose a non-linear mapping approach which can find non-linesar relationships between languages by kernel Canonical Correlation Analysis. |
| Outcome: | The proposed approach improves on five language pairs on supervised and self-learning scenarios. |
Similar Papers
Analyzing the Limitations of Cross-lingual Word Embedding Mappings (P19-1)
Copied to clipboard
| Challenge: | Existing methods for cross-lingual word embeddings have limited results . existing methods require little or no cross-linguistic signal to work . |
| Approach: | They compare offline mapping methods to an extension of skip-gram that jointly learns both embedding spaces. |
| Outcome: | The proposed method yields more isomorphic embeddings, is less sensitive to hubness, and achieves stronger results in bilingual lexicon induction. |
Characterizing Departures from Linearity in Word Translation (P18-2)
Copied to clipboard
| Challenge: | a class of methods has emerged to learn linear maps between word embedding spaces of different languages. |
| Approach: | They propose to approximate word embedding spaces using linear maps . they show that the underlying maps are non-linear but vary by a proportion of distance . |
| Outcome: | The proposed methods can be used to test non-linear methods and drive the design of more accurate maps for word translation. |
Linear Cross-Lingual Mapping of Sentence Embeddings (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing studies show that a sentence has less ambiguity than a single word . if the word semantics is changed in translation, then a better translation is possible. |
| Approach: | They propose a linear cross-lingual mapping to improve multilingual embeddings . they also consider deviation from orthogonality conditions as a measure of deficiency . |
| Outcome: | The proposed method improves the multilingual embeddings by allowing for a linear cross-lingual mapping. |
Improving Cross-Lingual Word Embeddings by Meeting in the Middle (D18-1)
Copied to clipboard
| Challenge: | Cross-lingual word embeddings are becoming increasingly important in multilingual NLP. |
| Approach: | They propose to apply an additional transformation after initial alignment to align two disjoint monolingual vector spaces. |
| Outcome: | The proposed approach outperforms state-of-the-art models in monolingual and cross-lingual evaluation tasks. |
Are Girls Neko or Shōjo? Cross-Lingual Alignment of Non-Isomorphic Embeddings with Iterative Normalization (P19-1)
Copied to clipboard
| Challenge: | Cross-lingual word embeddings (CLWE) are used to perform multilingual natural language processing tasks. |
| Approach: | They propose a method that transforms monolingual embeddings to make orthogonal alignment easier by simultaneously enforcing that (1) individual word vectors are unit length, and (2) each language’s average vector is zero. |
| Outcome: | The proposed method improves translation accuracy of three CLWE methods, with the largest improvement observed on English-Japanese (2% to 44% test accuracy). |
LNMap: Departures from Isomorphic Assumption in Bilingual Lexicon Induction Through Non-Linear Mapping in Latent Space (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for bilingual lexicon induction are mapping-based, but they do not hold for closely related languages. |
| Approach: | They propose a semi-supervised method to learn cross-lingual word embeddings for BLI using a linear mapping function and a latent space of two independently trained autoencoders. |
| Outcome: | The proposed method outperforms existing models on 15 different language pairs on both directions. |
A Closer Look on Unsupervised Cross-lingual Word Embeddings Mapping (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for word embeddings are limited to a single, unannotated corpus, which means that word representations with similar meaning in distinct languages can be very different. |
| Approach: | They propose an unsupervised method for cross-lingual word embedding mapping that uses stochastic initialization and isometric initialization to verify the method's robustness. |
| Outcome: | The proposed method is robust on different embedding representations and new language pairs, particularly those involving Slavic languages like Polish or Czech. |
On the Robustness of Unsupervised and Semi-supervised Cross-lingual Word Embedding Learning (2020.lrec-1)
Copied to clipboard
| Challenge: | Cross-lingual word embeddings are vector representations of words in different languages where words with similar meaning are represented by similar vectors, regardless of the language. |
| Approach: | They propose to evaluate multiple cross-lingual word embedding models and compare their strengths and limitations to evaluate their effectiveness. |
| Outcome: | The proposed models perform well with noisy text and language pairs with major differences. |
A Simple Approach to Learning Unsupervised Multilingual Embeddings (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent work on unsupervised cross-lingual embeddings in the bilingual setting has given the impetus to learning a shared embeddable space for several languages. |
| Approach: | They propose to solve two sub-problems together to learn a shared embedding space for several languages. |
| Outcome: | The proposed approach outperforms existing methods in bilingual lexicon induction, cross-lingual word similarity, multilingual document classification, and multilingual dependency parsing tasks. |
A Resource-Free Evaluation Metric for Cross-Lingual Word Embeddings Based on Graph Modularity (P19-1)
Copied to clipboard
| Challenge: | Cross-lingual word embeddings encode the meaning of words from different languages into a shared low-dimensional space. |
| Approach: | They show that modularity can be used to improve unsupervised word embeddings . they show that it is useful for low-resource languages where one often has few bilingual pairs . |
| Outcome: | The proposed model improves unsupervised cross-lingual word embeddings on distant language pairs in low-resource settings. |