Papers by Livio Bioglio
UINAUIL: A Unified Benchmark for Italian Natural Language Understanding (2023.acl-demo)
Copied to clipboard
| Challenge: | a benchmark of six tasks for Italian Natural Language Understanding is presented . large language models (LLMs) have revolutionized the field of natural language processing . a few benchmarks exist for non-English languages, but only a handful are available for nonEnglish languages . |
| Approach: | They introduce a benchmark for Italian Natural Language Understanding that harmonizes the data format and exposes functionalities to facilitate data manipulation and evaluation of custom models. |
| Outcome: | The proposed benchmarks are based on the European Language Grid and available models in Italian and multilingual languages. |