Global Gallery: The Fine Art of Painting Culture Portraits through Multilingual Instruction Tuning (2024.naacl-long)
Copied to clipboard
| Challenge: | This study examines the ability of Large Language Models to encapsulate cultural nuances across diverse linguistic landscapes. |
| Approach: | They examine the efficacy of language-specific instruction tuning and the impact of pretraining on dominant language data in Large Language Models. |
| Outcome: | The findings highlight a nuanced landscape, with inconsistencies and biases, particularly in non-Western cultures. |
Similar Papers
Investigating Cultural Alignment of Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are used to represent the diversity of human experience and culturally sensitive topics. |
| Approach: | They propose a method leveraging anthropological reasoning to enhance cultural alignment by prompting LLMs with different pretraining data mixtures in Arabic and English. |
| Outcome: | The proposed method enables users to better represent the diversity of human experience and the plurality of different cultures. |
Disentangling Language and Culture for Evaluating Multilingual Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Extensive evaluations of large language models (LLMs) are conducted on a wide range of models, revealing a notable cultural-linguistic synergy phenomenon, where models exhibit better performance when questions are culturally aligned with the language. |
| Approach: | They propose a Dual Evaluation Framework to comprehensively assess the multilingual capabilities of large language models by decomposing evaluation along dimensions of linguistic medium and cultural context. |
| Outcome: | The proposed framework allows for a nuanced analysis of LLMs’ ability to process questions within both native and cross-cultural contexts cross-lingually. |
Multilingual Pretraining and Instruction Tuning Improve Cross-Lingual Knowledge Alignment, But Only Shallowly (2024.naacl-long)
Copied to clipboard
| Challenge: | Current large language models show imbalance abilities in different languages . authors propose two approaches to improve cross-lingual knowledge alignment . |
| Approach: | They propose a framework to assess cross-lingual knowledge alignment of large language models . they propose multilingual pretraining and multilingual instruction tuning to address this problem . |
| Outcome: | The proposed framework assesses the cross-lingual knowledge alignment of LLMs in performance, consistency and conductivity levels. |
MAKIEval: A Multilingual Automatic WiKidata-based Framework for Cultural Awareness Evaluation for LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) are used globally across many languages, but their English-centric pretraining raises concerns about cross-lingual disparities for cultural awareness . |
| Approach: | They introduce an automatic multilingual framework for evaluating cultural awareness in large language models across languages, regions, and topics. |
| Outcome: | The framework evaluates open-ended text generation, capturing how models express culturally grounded knowledge in natural language. |
Multilingual Instruction Tuning With Just a Pinch of Multilinguality (2024.findings-acl)
Copied to clipboard
| Challenge: | Using multilingual instruction tuning, large language models can be used to follow instructions in multiple languages . a multilingual model can be tuned on a wide range of languages, yet most datasets are limited to English . |
| Approach: | They investigate how multilinguality during instruction tuning affects instruction-following across languages . they find that only 40 multilingual examples improve multilingual instruction- follow . |
| Outcome: | The results show that multilingual models perform better on multilingual mixtures compared to monolingual models . the results suggest that building multilingual instruction-tuned models can be done with only 2-4 languages . |
The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Models (2026.acl-long)
Copied to clipboard
Yilun Liu, Chunguang Zhao, Mengyao Piao, Lingqi Miao, Shimin Tao, Minggui HE, Chenxin Liu, Zhang Li, null Mahongxia, Jiaxin Guo, Chen Liu, Liqun Deng, Jiansheng Wei, Xiaojun Meng, Fanyi Du, Daimeng Wei, Yanghua Xiao
| Challenge: | Existing multilingual evaluation benchmarks neglect cultural nuances and lack language coverage in subjective tasks. |
| Approach: | They propose a framework that categorizes evaluation tasks into three cultural layers and nine cognitive sub-layers. |
| Outcome: | The proposed framework surpasses prior coverage by up to 111% on 20+ LLMs. |
ALIGN: Word Association Learning for Cultural Alignment in Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Large language models exhibit cultural bias from over-represented viewpoints in training data, yet cultural alignment remains a challenge due to limited cultural knowledge and a lack of exploration into effective learning approaches. |
| Approach: | They propose a cost-efficient method for fine-tuning large language models on native speakers’ word-association norms and a preference optimization method to improve cultural alignment. |
| Outcome: | The proposed model trains Llama-3.1-8B and Qwen-2.5-7B on native speakers’ word-association norms and shows that such associations capture cultural knowledge. |
Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models that target a single language are not seen during finetuning, but are able to respond in multiple languages once deployed in downstream applications. |
| Approach: | They investigate the minimal amount of multilinguality required during finetuning to elicit effective cross-lingual generalisation in English-centric LLMs. |
| Outcome: | The proposed model can respond in as few as two to three languages to a user's query in English, but the degree to which a target language is seen during pretraining is limiting. |
Grounding Multilingual Multimodal LLMs With Cultural Knowledge (2025.emnlp-main)
Copied to clipboard
| Challenge: | a new data-centric approach could address cultural gaps in multimodal large language models . despite being trained on billions of image-text pairs, today's models are biased towards English and Western data. |
| Approach: | They propose a data-centric approach that directly grounds MLLMs in cultural knowledge. |
| Outcome: | The proposed approach outperforms open-source models on cultural-focused benchmarks without degrading results on mainstream vision–language tasks. |
Investigating the Multilingual Calibration Effects of Language Model Instruction Tuning (2026.eacl-short)
Copied to clipboard
Jerry Huang, Peng Lu, Qiuhao Zeng, Yusuke Iwasawa, Yutaka Matsuo, Sarath Chandar, Edison Marrese-Taylor, Irene Li
| Challenge: | despite advances in foundation model research, the relationship between large language models and their calibration remains an open area of research. |
| Approach: | They examine a gap in the calibration of large language models within multilingual settings to better understand how data scarcity can potentially lead to different calibration effects. |
| Outcome: | The proposed calibration gap is found in two multilingual benchmarks over 29 and 42 languages. |