Papers by Aleksandrs Berdicevskis
Superlim: A Swedish Language Understanding Evaluation Benchmark (2023.emnlp-main)
Copied to clipboard
Aleksandrs Berdicevskis, Gerlof Bouma, Robin Kurtz, Felix Morger, Joey Öhman, Yvonne Adesam, Lars Borin, Dana Dannélls, Markus Forsberg, Tim Isbister, Anna Lindahl, Martin Malmsten, Faton Rekathati, Magnus Sahlgren, Elena Volodina, Love Börjeson, Simon Hengchen, Nina Tahmasebi
| Challenge: | In this paper, we present a multi-task benchmark for Swedish language models . we address methodological challenges, such as mitigating the Anglocentric bias when creating datasets for a less-resourced language . |
| Approach: | They propose a multi-task NLP benchmark for Swedish language models . they propose to use superlim to evaluate Swedish language model performance . |
| Outcome: | The proposed benchmark does not approach ceiling performance on any of the tasks, suggesting it is difficult to implement. |
A Diachronic Treebank of Russian Spanning More Than a Thousand Years (2020.lrec-1)
Copied to clipboard
| Challenge: | TOROT is a treebank that spans from the earliest Old Church Slavonic to modern Russian texts. |
| Approach: | They describe a new version of the Troms Old Russian and Old Church Slavonic Treebank . it adds a modern subcorpus to the existing treebank of contemporary standard Russian . they describe the conversion of SynTagRus into a treebank covering every attested stage of Russian and OCS . |
| Outcome: | The TOROT 20200116 treebank covers all attested stages of Russian and OCS . it includes a modern subcorpus that was created by a conversion of the SynTagRus treebank . |