Papers by Maxim Bazhukov
RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs (2024.emnlp-main)
Copied to clipboard
Ekaterina Taktasheva, Maxim Bazhukov, Kirill Koncha, Alena Fenogenova, Ekaterina Artemova, Vladislav Mikhailov
| Challenge: | Existing resources for minimal pairs address a limited number of languages and lack diversity of language-specific grammatical phenomena. |
| Approach: | They propose to use a Russian benchmark of linguistic minimal pairs to evaluate grammatical knowledge of language models. |
| Outcome: | The proposed benchmark includes 45k pairs of sentences that differ in grammaticality and isolate a morphological, syntactic, or semantic phenomenon. |