Adversarial Propagation and Zero-Shot Cross-Lingual Transfer of Word Vector Specialization (D18-1)
Copied to clipboard
| Challenge: | Semantic specialization is a process of fine-tuning pre-trained distributional word vectors using external lexical knowledge to accentuate a particular semantic relation in the specialized vector space. |
| Approach: | They propose a method for specializing distributional word vectors using external lexical knowledge. |
| Outcome: | The proposed method improves on word similarity, dialog state tracking, and lexical simplification across three languages and on three tasks. |
Similar Papers
Semantic Specialization of Distributional Word Vectors (D19-2)
Copied to clipboard
| Challenge: | Distributional word vectors conflate various paradigmatic and syntagmatic lexico-semantic relations. |
| Approach: | This tutorial provides an overview of specialization methods for distributional word vectors . a common solution is to include external lexico-semantic knowledge in a reshaped vector space . |
| Outcome: | This paper provides an overview of specialization methods for distributional word vectors . the most recent developments include a new method for asymmetric relations in Euclidean . |
Cross-lingual Semantic Specialization via Lexical Relation Induction (D19-1)
Copied to clipboard
| Challenge: | Semantic specialization is not available in many languages because of their incomplete or non-existent structure. |
| Approach: | They propose a method that transfers specialization from a resource-rich source language to virtually any target language. |
| Outcome: | The proposed method performs lexical simplification, dialog state tracking, and textual similarity tasks in 5 languages. |
Enhancing Word Embeddings with Knowledge Extracted from Lexical Resources (2020.acl-srw)
Copied to clipboard
| Challenge: | In this paper, we present an effective method for semantic specialization of word vector representations. |
| Approach: | They propose a method for semantic specialization of word vector representations using BabelNet. |
| Outcome: | The proposed method improves on word similarity and dialog state tracking tasks. |
Explicit Retrofitting of Distributional Word Vectors (P18-1)
Copied to clipboard
| Challenge: | Existing models for word vector specialization focus on word co-occurrences from large text corpora, resulting in a tendency to fuse semantic similarity with other types of semantic relatedness. |
| Approach: | They propose to transform external lexico-semantic relations into training examples and learn an explicit retrofitting model. |
| Outcome: | The proposed model can specialize vector spaces of new languages and translate them to other languages. |
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning (2022.coling-1)
Copied to clipboard
Kunbo Ding, Weijie Liu, Yuejian Fang, Weiquan Mao, Zhe Zhao, Tao Zhu, Haoyan Liu, Rong Tian, Yiren Chen
| Challenge: | Existing zero-shot cross-lingual transfer methods rely on parallel corpora or bilingual dictionaries . however, its effect is limited by the gap between embedding clusters of different languages . |
| Approach: | They propose Embedding-Push, Attention-Pull, and Robust targets to transfer English embeddings to virtual multilingual embedders without semantic loss. |
| Outcome: | Experimental results show that the proposed method outperforms existing methods on cross-lingual tasks and can achieve a better multilingual alignment. |
Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing (N19-1)
Copied to clipboard
| Challenge: | Existing methods for multilingual transfer are limited by their dynamic nature. |
| Approach: | They propose a method that utilizes deep contextual embeddings, pretrained in an unsupervised fashion. |
| Outcome: | The proposed method outperforms the state-of-the-art on 6 languages, yielding an improvement of 6.8 LAS points on average. |
Unsupervised Cross-lingual Transfer of Word Embedding Spaces (D18-1)
Copied to clipboard
| Challenge: | Existing methods for cross-lingual word mapping require cross-linguistic supervision, but this is not available for many low resource languages. |
| Approach: | They propose an unsupervised method that learns transformation functions over corresponding word embedding spaces using a distributed distributional matching algorithm. |
| Outcome: | The proposed method performs better on bilingual lexicon induction and cross-lingual word similarity prediction datasets than other supervised and unsupervised methods. |
Post-Specialisation: Retrofitting Vectors of Words Unseen in Lexical Resources (N18-1)
Copied to clipboard
| Challenge: | Word vector specialisation is a portable, light-weight approach to fine-tuning distributional word vector spaces by injecting external knowledge from rich lexical resources such as WordNet. |
| Approach: | They propose a constraint-driven vector space specialisation method that embeds external knowledge into lexical resources into a deep neural network to specialise unseen words. |
| Outcome: | The proposed method preserves useful linguistic knowledge for seen words while propagating external signal to unseen words to improve their vector representations. |
Cross-lingual Multi-Level Adversarial Transfer to Enhance Low-Resource Name Tagging (N19-1)
Copied to clipboard
| Challenge: | Low-resource language name tagging is an important but challenging task. |
| Approach: | They propose a neural architecture that leverages multi-level adversarial transfer to improve name tagging for low-resource languages. |
| Outcome: | The proposed approach outperforms previous approaches on CoNLL data sets. |
Discriminating between Lexico-Semantic Relations with the Specialization Tensor Model (N18-2)
Copied to clipboard
| Challenge: | Existing methods to specialize distributional vectors to better reflect a particular relation are lacking in modern natural language processing. |
| Approach: | They propose a feed-forward neural architecture for discriminating between lexico-semantic relations . they propose to train relation classifiers using lexical relations from external resources . |
| Outcome: | The proposed model outperforms state-of-the-art models on two benchmark datasets and exhibits stable performance across languages. |