Papers by Naiara Perez
Sensitive Data Detection and Classification in Spanish Clinical Text: Experiments with BERT (2020.lrec-1)
Copied to clipboard
| Challenge: | Massive digital data processing can endanger personal data privacy . anonymisation involves removing or replacing sensitive information from data . |
| Approach: | They propose to use a BERT-based sequence labelling model to conduct an experiment on clinical datasets in Spanish. |
| Outcome: | The proposed model outperforms existing models on clinical datasets in Spanish and shows that it is highly competitive with other models. |
HitzalMed: Anonymisation of Clinical Text in Spanish (2020.lrec-1)
Copied to clipboard
| Challenge: | HITZALMED is a web-framed tool that performs automatic detection of sensitive information in clinical texts using machine learning algorithms reported to be competitive for the task. |
| Approach: | This paper presents a web-framed tool that performs automatic detection of sensitive information in clinical texts using machine learning algorithms reported to be competitive for the task. |
| Outcome: | The proposed tool is available online and can be configured by the user. |
NUBes: A Corpus of Negation and Uncertainty in Spanish Clinical Texts (2020.lrec-1)
Copied to clipboard
| Challenge: | Currently, there are not many corpora that cover propositional aspects of meaning . these include factuality, uncertainty, opinions, beliefs, intentions or subjectivity . |
| Approach: | They introduce the first version of the NUBes corpus (Negation and Uncertainty annotations in Biomedical texts in Spanish) . it includes an exhaustive comparison with similar corpora in Spanish and preliminary experiments using deep learning algorithms to validate the annotated dataset. |
| Outcome: | The proposed corpus is compared with similar corpora in Spanish and performs preliminary experiments using deep learning algorithms. |
Multi-LMentry: Can Multilingual LLMs Solve Elementary Tasks Across Languages? (2025.emnlp-main)
Copied to clipboard
Luca Moroni, Javier Aula-Blasco, Simone Conia, Irene Baucells, Naiara Perez, Silvia Paniagua Suárez, Anna Sallés, Malte Ostendorff, Júlia Falcão, Guijin Son, Aitor Gonzalez-Agirre, Roberto Navigli, Marta Villegas
| Challenge: | a recent study focused on complex, high-level tasks, but LMentry is limited to English . a multilingual evaluation of large language models is needed to address this gap, authors say . |
| Approach: | They propose a compact benchmark that enables systematic evaluation of large language models . they propose to use tasks that are trivial for humans but remain surprisingly difficult for LLMs . |
| Outcome: | The proposed benchmark is limited to English, leaving its insights linguistically narrow. |
IberoBench: A Benchmark for LLM Evaluation in Iberian Languages (2025.coling-main)
Copied to clipboard
Irene Baucells, Javier Aula-Blasco, Iria de-Dios-Flores, Silvia Paniagua Suárez, Naiara Perez, Anna Salles, Susana Sotelo Docio, Júlia Falcão, Jose Javier Saiz, Robiert Sepulveda Torres, Jeremy Barnes, Pablo Gamallo, Aitor Gonzalez-Agirre, German Rigau, Marta Villegas
| Challenge: | Existing multi-task benchmarks for Large Language Models are limited to English . a new benchmark is needed to evaluate models on a range of tasks . |
| Approach: | They propose a multilingual, multi-task benchmark for Iberian languages built on the LM Evaluation Harness framework. |
| Outcome: | The proposed benchmark covers 62 tasks divided into 179 subtasks and is available in Iberian, Basque, Catalan, Galician, European Spanish and European Portuguese. |
Instructing Large Language Models for Low-Resource Languages: A Systematic Study for Basque (2025.emnlp-main)
Copied to clipboard
Oscar Sainz, Naiara Perez, Julen Etxaniz, Joseba Fernandez de Landa, Itziar Aldabe, Iker García-Ferrero, Aimar Zabala, Ekhi Azurmendi, German Rigau, Eneko Agirre, Mikel Artetxe, Aitor Soroa
| Challenge: | Instructing language models with user intent requires large instruction datasets limited to a limited set of languages. |
| Approach: | They propose to use existing LLMs and synthetically generated instructions to train models with user intent. |
| Outcome: | The proposed model outperforms base non-instructed models on Basque without Basque instructions. |