Papers by Abdou Youssef
Semantic Compression for Word and Sentence Embeddings using Discrete Wavelet Transform (2024.findings-acl)
Copied to clipboard
| Challenge: | Discrete Wavelet Transforms (DWT) can be applied to NLP capturing a variety of linguistic and semantic properties. |
| Approach: | They propose to use Discrete Wavelet Transforms to analyze word and sentence embeddings . they show that DWT can reduce dimensionality of embeddables by 50-93% . |
| Outcome: | The proposed paradigm reduces embeddings' dimensionality by 50-93% while maintaining their quality. |