Papers by Saeth Wannasuphoprasit
Solving Cosine Similarity Underestimation between High Frequency Words by ℓ2 Norm Discounting (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to estimate cosine similarity between words have been proposed, but no solution has been proposed. |
| Approach: | They propose a method to discount the l2 norm of contextualised word embedding by the frequency of that word in a corpus when measuring the cosine similarities between words. |
| Outcome: | The proposed method underestimates the similarity scores between two words when used with contextualised token embeddings from masked language models such as BERT. |