Papers by Susana Sotelo
VeritasQA: A Truthfulness Benchmark Aimed at Multilingual Transferability (2025.coling-main)
Copied to clipboard
Javier Aula-Blasco, Júlia Falcão, Susana Sotelo, Silvia Paniagua, Aitor Gonzalez-Agirre, Marta Villegas
| Challenge: | Large Language Models (LLMs) struggle with falsehoods and model hallucination . many efforts struggle to surpass 50% accuracy, with only targeted techniques reaching around 65% . |
| Approach: | They propose a truthfulness benchmark that focuses on imitative falsehoods . they use a set of 353 questions and answers inspired by common misconceptions based on the language . |
| Outcome: | The benchmark is available in Spanish, Catalan, Galician and English . it measures the truthfulness of multilingual LLMs using 353 questions and answers . |
Pay Attention when you Pay the Bills. A Multilingual Corpus with Dependency-based and Semantic Annotation of Collocations. (P19-1)
Copied to clipboard
| Challenge: | resulting corpus can be useful for different NLP tasks such as natural language understanding or natural language generation. |
| Approach: | They propose to annotate 155k tokens and 1,526 collocations in context in a multilingual corpus in English, Portuguese, and Spanish. |
| Outcome: | The new corpus can be used to evaluate different approaches for collocation identification, which can be useful for different NLP tasks such as natural language understanding or natural language generation. |