A Representation Learning Approach to Animal Biodiversity Conservation (2020.coling-main)
Copied to clipboard
| Challenge: | Using vector embeddings, we can predict the conservation status of animal species using a machine learning model. |
| Approach: | They propose a method for predicting the conservation status of animal species using custom generated name embeddings from Wikipedia text and animal taxonomy data. |
| Outcome: | The proposed model predicts the conservation status of data deficient species and steers more focus towards them for protection. |
Similar Papers
Embeddings in Natural Language Processing (2020.coling-tutorials)
Copied to clipboard
| Challenge: | Embeddings have been a key topic of interest in NLP for the past decade . a quick warm-up introduction to NLP and why it is important to have a semantic comprehension of texts . |
| Approach: | This tutorial will provide a high-level synthesis of the main embedding techniques in NLP . it will start with word embedds and then move to other types of embeddable vectors . |
| Outcome: | This tutorial will provide a high-level synthesis of the main embedding techniques in NLP . it will start with word embedds and move to other types of embeddable representations . |
A supervised approach to taxonomy extraction using word embeddings (L18-1)
Copied to clipboard
| Challenge: | a recent evaluation of a method for organizing texts into a hierarchy showed that it did not outperform a baseline. |
| Approach: | They propose a method that uses supervised learning to combine multiple features with a support vector machine classifier including the baseline features. |
| Outcome: | The proposed method outperforms the baseline method and provides stronger method for identifying taxonomic relations than previous methods. |
Unsupervised Cross-Lingual Representation Learning (P19-4)
Copied to clipboard
| Challenge: | a comprehensive survey of cutting-edge weakly-supervised and unsupervised cross-lingual word representations is presented . |
| Approach: | This tutorial provides a comprehensive survey of recent work on weakly-supervised and unsupervised cross-lingual word representations. |
| Outcome: | This tutorial provides a comprehensive survey of cutting-edge weakly-supervised and unsupervised word representations. |
A Robust Self-Learning Method for Fully Unsupervised Cross-Lingual Mappings of Word Embeddings: Making the Method Robustly Reproducible as Well (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for fully unsupervised cross-lingual mapping of word embeddings are available to achieve such a mapping . |
| Approach: | They reproduce the experiments of Artetxe and Sgaard (2018) . they propose a robust self-learning method for fully unsupervised cross-lingual mappings of word embeddings. |
| Outcome: | The proposed method is feasible with minor assumptions, and it is able to be replicated in four languages. |
Advances in Pre-Training Distributed Word Representations (L18-1)
Copied to clipboard
| Challenge: | Pre-trained word representations are a building block of many Natural Language Processing and Machine Learning applications. |
| Approach: | They propose to combine known tricks and a set of publicly available pre-trained word vector representations to train high-quality representations. |
| Outcome: | The proposed models outperform the current state of the art on a number of tasks while maintaining a high training speed to scale to massive amount of data. |
SPECTER: Document-level Representation Learning using Citation-informed Transformers (2020.acl-main)
Copied to clipboard
| Challenge: | Recent Transformer language models do not leverage information on inter-document relatedness, which limits their document-level representation power. |
| Approach: | They propose a method to generate document-level embeddings using citation graphs. |
| Outcome: | The proposed method outperforms baselines on document-level tasks. |
Embedding Imputation with Grounded Language Information (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to embedding imputation use vector space properties or subword information to learn representations for rare or unseen words. |
| Approach: | They propose an online method to construct a knowledge graph from grounded information and an algorithm to map from the resulting graph to the space of the pre-trained embeddings. |
| Outcome: | The proposed method improves on a card-660 task by 11% and 17.8% respectively using GloVe embeddings. |
Leveraging a Bilingual Dictionary to Learn Wolastoqey Word Representations (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing word embeddings for lowresource languages require large corpora of running text to learn high quality representations. |
| Approach: | They leverage a bilingual dictionary to learn Wolastoqey word embeddings by encoding their corresponding English definitions into vector representations using pretrained English word and sequence representation models. |
| Outcome: | The proposed model outperforms baseline models without language-specific training or fine-tuning. |
Self-Discriminative Learning for Unsupervised Document Embedding (N19-1)
Copied to clipboard
| Challenge: | Existing methods for document embedding learning do not consider inter-document relationships. |
| Approach: | They propose to exploit the inter-document information and directly model the relations of documents in embedding space with a discriminative network and a novel objective. |
| Outcome: | The proposed method has errors that are 5 to 13% lower than state-of-the-art models and is even more pronounced in scarce label setting. |
GGP: Glossary Guided Post-processing for Word Embedding Learning (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing word embedding models require much training time and domain knowledge to improve. |
| Approach: | They propose a GGP-based word embedding model that incorporates the glossary and learns sense representations. |
| Outcome: | The proposed model outperforms existing models on topical/functional similarity datasets by 4.1% and 7%. |