Papers by Wassim Hamidouche
AfriqueLLM: How Data Mixing and Model Architecture Impact Continued Pre-training for African Languages (2026.acl-long)
Copied to clipboard
Hao Yu, Tianyi Xu, Michael A. Hedderich, Wassim Hamidouche, Syed Waqas Zamir, David Ifeoluwa Adelani
| Challenge: | Continued pretraining (CPT) is a practical route to language adaptation, but improvements on demanding capabilities such as mathematical reasoning are limited. |
| Approach: | They propose to use CPT to adapt large language models to African languages . they use math, code, and synthetic translated data to analyze their models . |
| Outcome: | The proposed models improve on multilingual benchmarks and document-level translation. |