Papers by Anna Salles
IberoBench: A Benchmark for LLM Evaluation in Iberian Languages (2025.coling-main)
Copied to clipboard
Irene Baucells, Javier Aula-Blasco, Iria de-Dios-Flores, Silvia Paniagua Suárez, Naiara Perez, Anna Salles, Susana Sotelo Docio, Júlia Falcão, Jose Javier Saiz, Robiert Sepulveda Torres, Jeremy Barnes, Pablo Gamallo, Aitor Gonzalez-Agirre, German Rigau, Marta Villegas
| Challenge: | Existing multi-task benchmarks for Large Language Models are limited to English . a new benchmark is needed to evaluate models on a range of tasks . |
| Approach: | They propose a multilingual, multi-task benchmark for Iberian languages built on the LM Evaluation Harness framework. |
| Outcome: | The proposed benchmark covers 62 tasks divided into 179 subtasks and is available in Iberian, Basque, Catalan, Galician, European Spanish and European Portuguese. |