Papers by Miroslav Blšták
SlovakBERT: Slovak Masked Language Model (2022.findings-emnlp)
Copied to clipboard
Matúš Pikuliak, Štefan Grivalský, Martin Konôpka, Miroslav Blšták, Martin Tamajka, Viktor Bachratý, Marian Simko, Pavol Balážik, Michal Trnka, Filip Uhlárik
| Challenge: | SlovakBERT is a new masked language model that is based on a Web-crawled corpus. |
| Approach: | They introduce a new Slovak-only transformers-based language model called SlovkBERT . they evaluate the model on several NLP tasks and establish a benchmark for Slovakia . |
| Outcome: | The proposed model achieves state-of-the-art on several NLP tasks and achieves best results . the proposed model could be used by other Slovak researchers or NLP practitioners . |