Papers by Gbemileke Onilude
Intriguing Properties of Compression on Multilingual Models (2022.emnlp-main)
Copied to clipboard
Kelechi Ogueji, Orevaoghene Ahia, Gbemileke Onilude, Sebastian Gehrmann, Sara Hooker, Julia Kreutzer
| Challenge: | Multilingual models are dependent on scaling to generalize to a growing number of languages . compression techniques can have disparate effects on model performance for low-resource languages if used sparsely . |
| Approach: | They propose to characterize the impact of sparsifying multilingual pre-trained language models during fine-tuning. |
| Outcome: | The proposed framework characterizes the impact of sparsifying multilingual pre-trained language models during fine-tuning. |