Challenge: Kazakh language remains underrepresented in the field of natural language processing despite the country's population exceeding twenty million . however, there is a lack of dedicated models and benchmark evaluations specifically tailored to Kazakh languages.
Approach: They propose to create a dataset specifically designed for Kazakh language with 23,000 questions sourced from authentic educational materials and manually validated by native speakers and educators.
Outcome: The first MMLU-style dataset specifically designed for Kazakh language.

Similar Papers

TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages (2025.acl-long)

Copied to clipboard

Challenge: preparing native language MMLU benchmarks is costly and limits representativeness of evaluation datasets.
Approach: They propose to use a Turkic language MMLU benchmark to assess massive multitask language understanding capabilities.
Outcome: The proposed benchmarks are based on a Turkic language morphosyntactic and cultural benchmark . the benchmarks evaluate a diverse range of open and proprietary multilingual large language models .
TurkishMMLU: Measuring Massive Multitask Language Understanding in Turkish (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing multiple choice question answering benchmarks employ automatic translation for multilingual evaluation, but this approach is error-prone and potentially introduces culturally biased questions.
Approach: They introduce the first multitask, multiple-choice Turkish QA benchmark, TurkishMMLU . they evaluate over 20 LLMs including open-source, closed-source and Turkish-adapted models .
Outcome: The proposed benchmarks evaluate the reasoning, comprehension, and mathematical abilities of large language models.
Stereotype Bias in a Bilingual Setting: A Culturally Grounded Evaluation in Kazakhstan (2026.acl-long)

Copied to clipboard

Challenge: Stereotype bias in language models is largely understudied in English . language models perform strongly on downstream NLP tasks, but they are pre-trained on large text corpora .
Approach: They use a dataset to assess stereotype bias in language models in Kazakhstan . they find that stereotype bias is most pronounced in code-mixed inputs .
Outcome: The proposed dataset shows that stereotype bias is most pronounced in code-mixed inputs.
KazakhTTS2: Extending the Open-Source Kazakh TTS Corpus With More Data, Speakers, and Topics (2022.lrec-1)

Copied to clipboard

Challenge: Text-to-speech (TTS) is a process of converting written text into speech.
Approach: They present an expanded version of their text-to-speech corpus for Kazakh . they propose to use the corpus to build high-quality TTS systems for the language .
Outcome: The constructed corpus is sufficient to build robust TTS models for Kazakh and other Turkic languages, with a subjective mean opinion score ranging from 3.6 to 4.2 for all the five speakers.
LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing SEA-focused benchmarks miss Lao-specific cultural grounding and linguistic properties.
Approach: They propose a multi-dimensional benchmark for assessing large language models in Lao . they use open-source and held-out subsets to evaluate languages with a hybrid pipeline .
Outcome: LaoBench is the first large-scale, high-quality, and multidimensional benchmark for assessing LLM language understanding and reasoning in Lao.
A Crowdsourced Open-Source Kazakh Speech Corpus and Initial Speech Recognition Baseline (2021.eacl-main)

Copied to clipboard

Challenge: The Kazakh speech corpus contains over 153,000 utterances spoken by participants from different regions and age groups, as well as both genders.
Approach: They propose to build an open-source Kazakh speech corpus for the Kazakh language that contains over 153,000 transcribed audio . they describe the data collection and preprocessing procedures followed by a description of the database specifications.
Outcome: The Kazakh speech corpus contains over 153,000 utterances spoken by participants from different regions and age groups, as well as both genders.
GreekMMLU: A Native-Sourced Multitask Benchmark for Evaluating Language Models in Greek (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluation benchmarks for large language models are limited for Greek . Existing datasets are often machine-translated from English, failing to capture Greek linguistic and cultural characteristics.
Approach: They propose a native-sourced benchmark for massive multitask language understanding in Greek . they publicize 16,857 samples and reserve 4,948 samples for a private leaderboard .
Outcome: The proposed model is based on 21,805 multiple-choice questions across 45 subject areas . the model is publicly released and reserved for a private leaderboard .
A Large-Scale Study of Machine Translation in Turkic Languages (2021.emnlp-main)

Copied to clipboard

Challenge: a large corpus covering 22 Turkic languages is included in this paper . low-resource MT evaluation has traditionally focused on European languages due to limitations of available technology and resources.
Approach: They present a case study of the practical application of MT in the Turkic language family . they propose to realize the gains of NMT for Turkic languages under high-resource to extremely low-resourced scenarios.
Outcome: The proposed study shows that the new methods can be used in the Turkic language family . the results highlight bottlenecks in building competitive systems .
KazParC: Kazakh Parallel Corpus for Machine Translation (2024.lrec-main)

Copied to clipboard

Challenge: Statistical machine translation gained ground over rule-based machine translation in the late 1990s thanks to its ability to learn from large bilingual corpora.
Approach: They propose to develop a parallel corpus for machine translation across Kazakh, English, Russian, and Turkish.
Outcome: The proposed model outperforms Google Translate and Yandex Translate in terms of performance and evaluation metrics.
Instruction Tuning on Public Government and Cultural Data for Low-Resource Language: a Case Study in Kazakh (2025.acl-long)

Copied to clipboard

Challenge: Instruction tuning in low-resource languages remains underexplored due to limited text data, particularly in government and cultural domains.
Approach: They propose to open-source a large-scale instruction-following dataset covering key institutional and cultural knowledge relevant to Kazakhstan.
Outcome: The proposed dataset improves LLMs’ understanding of procedural, legal, and structural governance topics.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations