Papers by Andrew Waters
Attention Word Embedding (2020.coling-main)
Copied to clipboard
| Challenge: | Word embedding models learn semantically rich vector representations of words . popular word embedders include word2vec, GloVe, and fastText . |
| Approach: | They propose an AWE-S model which integrates the attention mechanism into the CBOW model and incorporates subword information. |
| Outcome: | The proposed model outperforms the state-of-the-art model on word similarity datasets and when used for initialization of NLP models. |