| Challenge: | Distributional word vectors conflate various paradigmatic and syntagmatic lexico-semantic relations. |
| Approach: | This tutorial provides an overview of specialization methods for distributional word vectors . a common solution is to include external lexico-semantic knowledge in a reshaped vector space . |
| Outcome: | This paper provides an overview of specialization methods for distributional word vectors . the most recent developments include a new method for asymmetric relations in Euclidean . |
Similar Papers
Explicit Retrofitting of Distributional Word Vectors (P18-1)
Copied to clipboard
| Challenge: | Existing models for word vector specialization focus on word co-occurrences from large text corpora, resulting in a tendency to fuse semantic similarity with other types of semantic relatedness. |
| Approach: | They propose to transform external lexico-semantic relations into training examples and learn an explicit retrofitting model. |
| Outcome: | The proposed model can specialize vector spaces of new languages and translate them to other languages. |
Adversarial Propagation and Zero-Shot Cross-Lingual Transfer of Word Vector Specialization (D18-1)
Copied to clipboard
| Challenge: | Semantic specialization is a process of fine-tuning pre-trained distributional word vectors using external lexical knowledge to accentuate a particular semantic relation in the specialized vector space. |
| Approach: | They propose a method for specializing distributional word vectors using external lexical knowledge. |
| Outcome: | The proposed method improves on word similarity, dialog state tracking, and lexical simplification across three languages and on three tasks. |
Enhancing Word Embeddings with Knowledge Extracted from Lexical Resources (2020.acl-srw)
Copied to clipboard
| Challenge: | In this paper, we present an effective method for semantic specialization of word vector representations. |
| Approach: | They propose a method for semantic specialization of word vector representations using BabelNet. |
| Outcome: | The proposed method improves on word similarity and dialog state tracking tasks. |
Learning Lexical Subspaces in a Distributional Vector Space (2020.tacl-1)
Copied to clipboard
| Challenge: | Existing word embeddings that can cluster distributionally related words are weak, but they can be used to cluster words that might not be semantically similar. |
| Approach: | They propose a framework that injects lexical-semantic relations into distributional word embeddings by defining subspaces of the distributional vector space in which a lexically related relation should hold. |
| Outcome: | The proposed framework outperforms existing systems on relatedness and hypernymy tasks while being competitive on word similarity tasks. |
Cross-lingual Semantic Specialization via Lexical Relation Induction (D19-1)
Copied to clipboard
| Challenge: | Semantic specialization is not available in many languages because of their incomplete or non-existent structure. |
| Approach: | They propose a method that transfers specialization from a resource-rich source language to virtually any target language. |
| Outcome: | The proposed method performs lexical simplification, dialog state tracking, and textual similarity tasks in 5 languages. |
Discriminating between Lexico-Semantic Relations with the Specialization Tensor Model (N18-2)
Copied to clipboard
| Challenge: | Existing methods to specialize distributional vectors to better reflect a particular relation are lacking in modern natural language processing. |
| Approach: | They propose a feed-forward neural architecture for discriminating between lexico-semantic relations . they propose to train relation classifiers using lexical relations from external resources . |
| Outcome: | The proposed model outperforms state-of-the-art models on two benchmark datasets and exhibits stable performance across languages. |
Why is penguin more similar to polar bear than to sea gull? Analyzing conceptual knowledge in distributional models (2020.acl-srw)
Copied to clipboard
| Challenge: | Several analysis methods have been shown to be limited and are not well understood . thesis aims to understand distributional semantic representations based on linguistic data . |
| Approach: | They propose a framework for investigating the information encoded in distributional semantic models . they combine observations made on corpora with insights obtained from data manipulation experiments . |
| Outcome: | The proposed framework pairs observations made on corpora with insights obtained from data manipulation experiments. |
Cross-Topic Distributional Semantic Representations Via Unsupervised Mappings (N19-1)
Copied to clipboard
| Challenge: | Existing distributional semantic models cannot capture the distinct meanings of polysemous words, resulting in conflated word representations of diverse contextual semantics. |
| Approach: | They propose a distributional semantic model that learns multiple representations of a word based on different topics. |
| Outcome: | The proposed model outperforms single-prototype models on NLP downstream tasks. |
Can Network Embedding of Distributional Thesaurus Be Combined with Word Vectors for Better Representation? (N18-1)
Copied to clipboard
| Challenge: | Distributed representations of words learned from text have proved to be successful in various natural language processing tasks. |
| Approach: | They propose to embed a distributional thesaurus network into dense word vectors and compare them to state-of-the-art word representations. |
| Outcome: | The proposed representations improve performance against state-of-the-art word representations even without handcrafted lexical resources. |
What are the Goals of Distributional Semantics? (2020.acl-main)
Copied to clipboard
| Challenge: | a new paper examines distributional semantic models' ability to deal with semantic challenges . authors argue that assessing progress in any field requires explicit long-term goals . |
| Approach: | They propose a broad linguistic perspective to assess distributional semantic models' ability to deal with various semantic challenges. |
| Outcome: | The proposed models can handle various semantic challenges, but they need to be explicit . a top-down approach is largely bottom-up, while a bottom-down one is mainly top-up . the authors argue that the goal is unclear and that the models are not scalable . |