Papers by Konstantinos Skianis
GreekMMLU: A Native-Sourced Multitask Benchmark for Evaluating Language Models in Greek (2026.findings-acl)
Copied to clipboard
Yang Zhang, Mersin Konomi, Christos Xypolopoulos, Konstantinos Divriotis, Konstantinos Skianis, Giannis Nikolentzos, Giorgos Stamou, Guokan Shang, Michalis Vazirgiannis
| Challenge: | Existing evaluation benchmarks for large language models are limited for Greek . Existing datasets are often machine-translated from English, failing to capture Greek linguistic and cultural characteristics. |
| Approach: | They propose a native-sourced benchmark for massive multitask language understanding in Greek . they publicize 16,857 samples and reserve 4,948 samples for a private leaderboard . |
| Outcome: | The proposed model is based on 21,805 multiple-choice questions across 45 subject areas . the model is publicly released and reserved for a private leaderboard . |
Evaluation of Greek Word Embeddings (2020.lrec-1)
Copied to clipboard
| Challenge: | Word embeddings are the most popular input for many NLP tasks. |
| Approach: | They propose to use Greek word embeddings as an unsupervised learning tool . they use a Greek word analogy test set and a morphological test collection to evaluate word similarities . |
| Outcome: | The proposed model is able to create meaningful representations of Greek words . the proposed model can be adapted to Greek language and polysemy . |