Multi-lingual Common Semantic Space Construction via Cluster-consistent Word Embedding (D18-1)
Copied to clipboard
| Challenge: | a new approach to multilingual word embedding is needed to achieve this goal . a multilingual common semantic space is a language-agnostic semantic continuous space . |
| Approach: | They propose a multilingual common semantic space where words from multiple languages are mapped into a shared space so that resources and knowledge can be shared across languages. |
| Outcome: | The proposed approach achieves 14.6% absolute F-score gain over state-of-the-art methods on cross-lingual direct transfer. |
Similar Papers
A Simple Approach to Learning Unsupervised Multilingual Embeddings (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent work on unsupervised cross-lingual embeddings in the bilingual setting has given the impetus to learning a shared embeddable space for several languages. |
| Approach: | They propose to solve two sub-problems together to learn a shared embedding space for several languages. |
| Outcome: | The proposed approach outperforms existing methods in bilingual lexicon induction, cross-lingual word similarity, multilingual document classification, and multilingual dependency parsing tasks. |
KIT-Multi: A Translation-Oriented Multilingual Embedding Corpus (L18-1)
Copied to clipboard
| Challenge: | Cross-lingual word embeddings are representations of words across languages in a shared continuous vector space. |
| Approach: | They propose a multilingual word embedding corpus which is acquired by neural machine translation and is based on monolingual data. |
| Outcome: | The proposed method is competitive with existing methods but on the cross-lingual document classification task, it obtains the best figures. |
Learning Unsupervised Multilingual Word Embeddings with Incremental Multilingual Hubs (N19-1)
Copied to clipboard
| Challenge: | Recent research has found that a shared bilingual word embedding space can be induced by projecting monolingual word embeds from two languages without any bilingual supervision. |
| Approach: | They propose a framework for learning unsupervised multilingual word embeddings that mitigates instability issues for distant language pairs. |
| Outcome: | The proposed framework outperforms the state-of-the-art methods on two downstream tasks outperforming even supervised baselines. |
Hierarchical Mapping for Crosslingual Word Embedding Alignment (2020.tacl-1)
Copied to clipboard
| Challenge: | Existing strategies that map word embeddings into a crosslingual space are biased towards the choice of the pivot language. |
| Approach: | They propose to map any two languages into a different middle space by learning mappings across languages in a hierarchical way. |
| Outcome: | The proposed strategy significantly improves vocabulary induction scores in all existing benchmarks and in a new non-English–centered benchmark. |
Improving Cross-Lingual Word Embeddings by Meeting in the Middle (D18-1)
Copied to clipboard
| Challenge: | Cross-lingual word embeddings are becoming increasingly important in multilingual NLP. |
| Approach: | They propose to apply an additional transformation after initial alignment to align two disjoint monolingual vector spaces. |
| Outcome: | The proposed approach outperforms state-of-the-art models in monolingual and cross-lingual evaluation tasks. |
Embedding Learning Through Multilingual Concept Induction (P18-1)
Copied to clipboard
| Challenge: | Existing methods for learning vector space representations of words are based on word-context information. |
| Approach: | They propose a method for estimating vector space representations of words by concept induction. |
| Outcome: | The proposed method performs better on crosslingual word similarity and sentiment analysis on a parallel corpus. |
Unsupervised Multilingual Word Embedding with Limited Resources using Neural Language Models (P19-1)
Copied to clipboard
| Challenge: | Existing methods that map word embeddings into a common space without any parallel data or pre-training have been proposed that are limited in resources and perform poorly under resource-poor conditions. |
| Approach: | They propose a model that maps monolingual word embeddings into a common space without any parallel data and generates multilingual embeddables without any pre-training. |
| Outcome: | The proposed model outperforms existing methods on word alignment tasks on low-resource conditions and with limited resources. |
NORMA: Neighborhood Sensitive Maps for Multilingual Word Embeddings (D18-1)
Copied to clipboard
| Challenge: | Existing methods for learning multilingual word embeddings assume that embeddable spaces of different languages exhibit similar structures. |
| Approach: | They propose a method for learning neighborhood sensitive maps to capture such differences . aim is to learn word vectors where similar words have similar vector representations . |
| Outcome: | The proposed method outperforms state-of-the-art methods for translation between distant languages. |
Unsupervised Cross-lingual Transfer of Word Embedding Spaces (D18-1)
Copied to clipboard
| Challenge: | Existing methods for cross-lingual word mapping require cross-linguistic supervision, but this is not available for many low resource languages. |
| Approach: | They propose an unsupervised method that learns transformation functions over corresponding word embedding spaces using a distributed distributional matching algorithm. |
| Outcome: | The proposed method performs better on bilingual lexicon induction and cross-lingual word similarity prediction datasets than other supervised and unsupervised methods. |
Exploring Alignment in Shared Cross-lingual Spaces (2024.acl-long)
Copied to clipboard
| Challenge: | a new study examines the degree of alignment between languages in multilingual embeddings . cross-lingual embeds are designed to encode linguistic concepts that bridge equivalent semantic meaning . a comprehensive approach is needed to address these questions. |
| Approach: | They employ clustering to uncover latent concepts within multilingual models . they introduce two metrics to quantify alignment and overlap of these concepts . |
| Outcome: | The proposed model can capture linguistic nuances across languages, but is not language-agnostic? the proposed model is able to capture nuances in multiple languages, the authors say. |