Joint Semantic and Distributional Word Representations with Multi-Graph Embeddings (D19-53)
Copied to clipboard
| Challenge: | Prior work has shown that word embeddings can be improved by using semantic knowledge-bases. |
| Approach: | They propose a way to combine distributional and semantic information while preserving lexical information of co-occurrences of words. |
| Outcome: | The proposed method improves word embeddings on a variety of word similarities. |
Similar Papers
Can Network Embedding of Distributional Thesaurus Be Combined with Word Vectors for Better Representation? (N18-1)
Copied to clipboard
| Challenge: | Distributed representations of words learned from text have proved to be successful in various natural language processing tasks. |
| Approach: | They propose to embed a distributional thesaurus network into dense word vectors and compare them to state-of-the-art word representations. |
| Outcome: | The proposed representations improve performance against state-of-the-art word representations even without handcrafted lexical resources. |
Multi-lingual Common Semantic Space Construction via Cluster-consistent Word Embedding (D18-1)
Copied to clipboard
| Challenge: | a new approach to multilingual word embedding is needed to achieve this goal . a multilingual common semantic space is a language-agnostic semantic continuous space . |
| Approach: | They propose a multilingual common semantic space where words from multiple languages are mapped into a shared space so that resources and knowledge can be shared across languages. |
| Outcome: | The proposed approach achieves 14.6% absolute F-score gain over state-of-the-art methods on cross-lingual direct transfer. |
Enhancing Word Embeddings with Knowledge Extracted from Lexical Resources (2020.acl-srw)
Copied to clipboard
| Challenge: | In this paper, we present an effective method for semantic specialization of word vector representations. |
| Approach: | They propose a method for semantic specialization of word vector representations using BabelNet. |
| Outcome: | The proposed method improves on word similarity and dialog state tracking tasks. |
Embeddings in Natural Language Processing (2020.coling-tutorials)
Copied to clipboard
| Challenge: | Embeddings have been a key topic of interest in NLP for the past decade . a quick warm-up introduction to NLP and why it is important to have a semantic comprehension of texts . |
| Approach: | This tutorial will provide a high-level synthesis of the main embedding techniques in NLP . it will start with word embedds and then move to other types of embeddable vectors . |
| Outcome: | This tutorial will provide a high-level synthesis of the main embedding techniques in NLP . it will start with word embedds and move to other types of embeddable representations . |
Relational Word Embeddings (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to learn word embeddings rely on external knowledge bases . however, they are limited by the amount of available relational knowledge . |
| Approach: | They propose to encode relational knowledge in a separate word embedding . this is complementary to a standard word embedded from co-occurrence statistics . |
| Outcome: | The proposed word embedding is complementary to a standard word embed. |
Cross-Topic Distributional Semantic Representations Via Unsupervised Mappings (N19-1)
Copied to clipboard
| Challenge: | Existing distributional semantic models cannot capture the distinct meanings of polysemous words, resulting in conflated word representations of diverse contextual semantics. |
| Approach: | They propose a distributional semantic model that learns multiple representations of a word based on different topics. |
| Outcome: | The proposed model outperforms single-prototype models on NLP downstream tasks. |
Improved Semantic-Aware Network Embedding with Fine-Grained Word Alignment (D18-1)
Copied to clipboard
| Challenge: | Existing approaches to network embeddings focus on one-hot representations of vertices, which are not able to capture relationships between verti- ces. |
| Approach: | They propose to integrate semantic features into network embeddings by matching important words between text sequences for all pairs of vertices. |
| Outcome: | The proposed framework outperforms state-of-the-art embedding methods on three real-world benchmarks for downstream tasks including link prediction and multi-label vertex classification. |
From Text to Lexicon: Bridging the Gap between Word Embeddings and Lexical Resources (C18-1)
Copied to clipboard
| Challenge: | Distributional word representations are omnipresent in modern NLP. |
| Approach: | They propose to combine lemmatization and part of speech (POS) typing to improve word embedding performance. |
| Outcome: | The proposed methods improve word embedding performance on verbs and verbs. |
KIT-Multi: A Translation-Oriented Multilingual Embedding Corpus (L18-1)
Copied to clipboard
| Challenge: | Cross-lingual word embeddings are representations of words across languages in a shared continuous vector space. |
| Approach: | They propose a multilingual word embedding corpus which is acquired by neural machine translation and is based on monolingual data. |
| Outcome: | The proposed method is competitive with existing methods but on the cross-lingual document classification task, it obtains the best figures. |
Joint Learning of Sense and Word Embeddings (L18-1)
Copied to clipboard
| Challenge: | Existing methods for learning lower-dimensional representations of words using unlabelled data learn a single representation for a word, ignoring the different senses of that word (polysemy). |
| Approach: | They propose a method that jointly learns sense-aware word embeddings using both unlabelled and sense-tagged text corpora. |
| Outcome: | The proposed method outperforms competing methods on word similarity and short-text classification benchmark datasets. |