Papers by Yishi Xu
FLOR: On the Effectiveness of Language Adaptation (2024.lrec-main)
Copied to clipboard
Severino Da Dalt, Joan Llop, Irene Baucells, Marc Pamies, Yishi Xu, Aitor Gonzalez-Agirre, Marta Villegas
| Challenge: | Large language models have amply proven their capabilities, but low- and mid-resource languages do not have access to the necessary means to train such models from scratch. |
| Approach: | They use a 26B tokens corpus to further pre-train BLOOM, giving rise to FLOR models. |
| Outcome: | The proposed model achieves consistent gains across Catalan and Spanish tasks. |