Cross-Topic Distributional Semantic Representations Via Unsupervised Mappings (N19-1)
Copied to clipboard
| Challenge: | Existing distributional semantic models cannot capture the distinct meanings of polysemous words, resulting in conflated word representations of diverse contextual semantics. |
| Approach: | They propose a distributional semantic model that learns multiple representations of a word based on different topics. |
| Outcome: | The proposed model outperforms single-prototype models on NLP downstream tasks. |
Similar Papers
Semantic Specialization of Distributional Word Vectors (D19-2)
Copied to clipboard
| Challenge: | Distributional word vectors conflate various paradigmatic and syntagmatic lexico-semantic relations. |
| Approach: | This tutorial provides an overview of specialization methods for distributional word vectors . a common solution is to include external lexico-semantic knowledge in a reshaped vector space . |
| Outcome: | This paper provides an overview of specialization methods for distributional word vectors . the most recent developments include a new method for asymmetric relations in Euclidean . |
Joint Semantic and Distributional Word Representations with Multi-Graph Embeddings (D19-53)
Copied to clipboard
| Challenge: | Prior work has shown that word embeddings can be improved by using semantic knowledge-bases. |
| Approach: | They propose a way to combine distributional and semantic information while preserving lexical information of co-occurrences of words. |
| Outcome: | The proposed method improves word embeddings on a variety of word similarities. |
A Simple Approach to Learning Unsupervised Multilingual Embeddings (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent work on unsupervised cross-lingual embeddings in the bilingual setting has given the impetus to learning a shared embeddable space for several languages. |
| Approach: | They propose to solve two sub-problems together to learn a shared embedding space for several languages. |
| Outcome: | The proposed approach outperforms existing methods in bilingual lexicon induction, cross-lingual word similarity, multilingual document classification, and multilingual dependency parsing tasks. |
Unsupervised Cross-lingual Transfer of Word Embedding Spaces (D18-1)
Copied to clipboard
| Challenge: | Existing methods for cross-lingual word mapping require cross-linguistic supervision, but this is not available for many low resource languages. |
| Approach: | They propose an unsupervised method that learns transformation functions over corresponding word embedding spaces using a distributed distributional matching algorithm. |
| Outcome: | The proposed method performs better on bilingual lexicon induction and cross-lingual word similarity prediction datasets than other supervised and unsupervised methods. |
Unsupervised Cross-Lingual Representation Learning (P19-4)
Copied to clipboard
| Challenge: | a comprehensive survey of cutting-edge weakly-supervised and unsupervised cross-lingual word representations is presented . |
| Approach: | This tutorial provides a comprehensive survey of recent work on weakly-supervised and unsupervised cross-lingual word representations. |
| Outcome: | This tutorial provides a comprehensive survey of cutting-edge weakly-supervised and unsupervised word representations. |
Multi-source Neural Topic Modeling in Multi-view Embedding Spaces (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent work has used pre-trained word embeddings to address data sparsity in short-text or small document collections. |
| Approach: | They propose a neural topic modeling framework using multi-view embedding spaces to improve topic quality and deal with polysemy. |
| Outcome: | The proposed framework improves topic quality and deal with polysemy. |
Explicit Retrofitting of Distributional Word Vectors (P18-1)
Copied to clipboard
| Challenge: | Existing models for word vector specialization focus on word co-occurrences from large text corpora, resulting in a tendency to fuse semantic similarity with other types of semantic relatedness. |
| Approach: | They propose to transform external lexico-semantic relations into training examples and learn an explicit retrofitting model. |
| Outcome: | The proposed model can specialize vector spaces of new languages and translate them to other languages. |
XTRA: Cross-Lingual Topic Modeling with Topic and Representation Alignments (2025.findings-emnlp)
Copied to clipboard
| Challenge: | XTRA aims to uncover shared semantic themes across languages . previous methods have achieved improvements in topic diversity but struggle to ensure high topic coherence and consistent alignment across languages. |
| Approach: | a new framework unifies Bag-of-Words modeling with multilingual embeddings is proposed to address this problem . XTRA introduces two core components: (1) representation alignment and (2) topic alignment to enforce cross-lingual consistency. |
| Outcome: | XTRA outperforms baselines in topic coherence, diversity, and alignment quality on multilingual corpora. |
A Neural Generative Model for Joint Learning Topics and Topic-Specific Word Embeddings (2020.tacl-1)
Copied to clipboard
| Challenge: | Experimental results show that the proposed model outperforms word-level embedding methods in word similarity evaluation and word sense disambiguation. |
| Approach: | They propose a generative model that explores local and global context for joint learning topics and topic-specific word embeddings. |
| Outcome: | The proposed model outperforms word-level embedding methods in word similarity evaluation and word sense disambiguation. |
A Closer Look on Unsupervised Cross-lingual Word Embeddings Mapping (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for word embeddings are limited to a single, unannotated corpus, which means that word representations with similar meaning in distinct languages can be very different. |
| Approach: | They propose an unsupervised method for cross-lingual word embedding mapping that uses stochastic initialization and isometric initialization to verify the method's robustness. |
| Outcome: | The proposed method is robust on different embedding representations and new language pairs, particularly those involving Slavic languages like Polish or Czech. |