Papers by Tatiana Shamardina
RuCoLA: Russian Corpus of Linguistic Acceptability (2022.emnlp-main)
Copied to clipboard
Vladislav Mikhailov, Tatiana Shamardina, Max Ryabinin, Alena Pestova, Ivan Smurov, Ekaterina Artemova
| Challenge: | Recent research has focused on evaluating the grammatical knowledge of language models with acceptability judgments. |
| Approach: | They propose to build a corpus of linguistic acceptability in Russian using a binary LA approach. |
| Outcome: | The proposed set of tests shows that the most widely used language models still fall behind humans by a large margin when detecting morphological and semantic errors. |