Papers by Quulgan Minggad
MonCulture-Eval: A Hierarchical Benchmark for Evaluating Mongolian Cultural Capabilities of Large Language Models across Scripts and Regions (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models excel at multilingual translation and instruction-following in low-resource settings like Tibetan, but lack cultural intelligence quantification. |
| Approach: | They propose a benchmark to assess the cultural intelligence of Large Language Models in Mongolia . they use a three-layer cognitive hierarchy and specialized tasks to assess their cultural intelligence . |
| Outcome: | The monCulture-Eval benchmark assesses the cultural intelligence of large language models in the Mongolian context across two writing systems and three regional sub-cultures. |
Diversity in Unity, Theory in Practice: Hierarchical Multitask Benchmarks for Chinese Minority Languages (2026.acl-long)
Copied to clipboard
| Challenge: | CMiLBench is a framework to evaluate linguistically and culturally diverse minority languages . rapid evolution of LLMs has revolutionized NLP, but progress is unevenly distributed . |
| Approach: | They propose a framework to translate a theoretical notion of "diversity in unity" into practical evaluation for three minority languages . CMiLBench comprises 24,663 instances across 5 difficulty levels and 17 tasks . |
| Outcome: | The proposed framework evaluates 14 state-of-the-art LLMs with a hybrid framework . it integrates automatic metrics and LLM-as-a-Judge scoring . |