Specializing Word Vectors by Spectral Decomposition on Heterogeneously Twisted Graphs (2020.coling-main)
Copied to clipboard
| Challenge: | Word vectors have a tendency to conflate semantic similarity with semantic relatedness . a new method is proposed to retrofit word vectors with lexical constraints . |
| Approach: | They propose a method that heterogeneously retrofits a similarity matrix with lexical constraints. |
| Outcome: | The proposed method has a competitive performance compared with the state-of-the-art methods. |
Similar Papers
Retrofitting Word Representations for Unsupervised Sense Aware Word Similarities (L18-1)
Copied to clipboard
| Challenge: | Standard word embeddings lack the ability to distinguish senses of a word by projecting them to exactly one vector. |
| Approach: | They propose to retrofit standard word embeddings to produce sense-aware embeddable vectors using external resources as sense inventories. |
| Outcome: | The proposed method improves word similarity and relatedness scores on multiple word embeddings and established word similarities, sometimes up to an impressive margin of +0.15 Spearman correlation score. |
Using Context-to-Vector with Graph Retrofitting to Improve Word Embeddings (2022.acl-long)
Copied to clipboard
| Challenge: | Contextualized embeddings are expensive and resource-demanding, hence environmentally unfriendly. |
| Approach: | They propose a method to convert contextualized embeddings from pre-trained models into static embeddables using synonym knowledge and weighted vector distribution. |
| Outcome: | The proposed method outperforms baseline embeddings by a large margin through extrinsic and intrinsic tasks. |
A Retrofitting Model for Incorporating Semantic Relations into Word Embeddings (2020.coling-main)
Copied to clipboard
| Challenge: | Existing word embedding models mix semantic similarity with other types of relatedness. |
| Approach: | They propose a model that leverages relational knowledge available in a knowledge resource to improve word embeddings. |
| Outcome: | The proposed model improves word embeddings on synonymy, antonymy and hypernymy relations in WordNet and significantly improves lexical entailment detection task. |
Explicit Retrofitting of Distributional Word Vectors (P18-1)
Copied to clipboard
| Challenge: | Existing models for word vector specialization focus on word co-occurrences from large text corpora, resulting in a tendency to fuse semantic similarity with other types of semantic relatedness. |
| Approach: | They propose to transform external lexico-semantic relations into training examples and learn an explicit retrofitting model. |
| Outcome: | The proposed model can specialize vector spaces of new languages and translate them to other languages. |
Affective Retrofitted Word Embeddings (2022.aacl-main)
Copied to clipboard
| Challenge: | Word embeddings do not capture affective dimensions of valence, arousal, and dominance . valency, valance, and adolescence are present in words, but are not represented in text . |
| Approach: | They propose a method for updating word embeddings for affective meaning . they use a non-linear transformation function that maps pre-trained embedders to an affective vector space . |
| Outcome: | The proposed method improves inter-cluster and intra-c cluster distances for emotion-bearing words. |
Emotion Enriched Retrofitted Word Embeddings (2022.coling-1)
Copied to clipboard
| Challenge: | Word embeddings that encode lexical-semantic relations do not capture emotion aspects of words. |
| Approach: | They propose a retrofitting method to update the vectors of emotion bearing words . they find that the retrofitted embeddings achieve better distances between clusters . |
| Outcome: | The proposed method achieves better distances between clusters and clusters for words having the same emotions. |
What just happened? Evaluating retrofitted distributional word vectors (N19-1)
Copied to clipboard
| Challenge: | Recent work has attempted to enhance vector space representations using information from structured semantic resources. |
| Approach: | They propose a root-mean-square error evaluation metric to evaluate the utility of different lexical resources for retrofitting. |
| Outcome: | The proposed method improves word similarity performance by using root-mean-square error (RMSE) and root-macro-error (RMME) metric. |
Enhanced Word Representations for Bridging Anaphora Resolution (N18-2)
Copied to clipboard
| Challenge: | Existing word representations do not capture semantic similarity for bridging anaphora resolution. |
| Approach: | They propose to use word embeddings to capture semantic similarity by exploring syntactic structure of noun phrases. |
| Outcome: | The proposed model achieves 30% of accuracy for bridging anaphora resolution on ISNotes corpus. |
Enhancing Word Embeddings with Knowledge Extracted from Lexical Resources (2020.acl-srw)
Copied to clipboard
| Challenge: | In this paper, we present an effective method for semantic specialization of word vector representations. |
| Approach: | They propose a method for semantic specialization of word vector representations using BabelNet. |
| Outcome: | The proposed method improves on word similarity and dialog state tracking tasks. |
Using pseudo-senses for improving the extraction of synonyms from word embeddings (P18-2)
Copied to clipboard
| Challenge: | Existing methods for specializing word embeddings rely on external knowledge . we propose a new method that focuses on semantic similarity and synonym extraction without external knowledge. |
| Approach: | They propose a method that exploits pseudo-sense for building several representations for each word and uses these representations to make initial embeddings more generic. |
| Outcome: | The proposed method improves word embeddings without external knowledge and focuses on semantic similarity and synonym extraction. |