Papers by Jordi Luque
Recycle Your Wav2Vec2 Codebook: A Speech Perceiver for Keyword Spotting (2022.coling-1)
Copied to clipboard
| Challenge: | Pretraining a keyword Spotting model with a pretraining encoder is expensive and requires a quadratic cost. |
| Approach: | They propose to recycle phonetic information encoded in wav2vec2.0's latent codebook, which has been typically thrown away after pretraining. |
| Outcome: | The proposed model can be initialized with phonetic embeddings, and it delivers accuracy gains at no latency costs. |