Reading between the Lines: Can LLMs Identify Cross-Cultural Communication Gaps? (2025.naacl-long)
Copied to clipboard
| Challenge: | a new study examines the extent and patterns of gaps in understandability of book reviews . 83% of the reviews had at least one culturally-specific difficult-to-understand element . |
| Approach: | They examine extent and patterns of gaps in understandability of book reviews . 83% of reviews had at least one culturally-specific difficult-to-understand element . authors say they have a significant scope for improvement . |
| Outcome: | The proposed approach improves the understanding of book reviews from different cultures . 83% of the reviews had at least one culturally-specific difficult-to-understand element . |
Similar Papers
Do LLMs Understand Wine Descriptors Across Cultures? A Benchmark for Cultural Adaptations of Wine Reviews (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in large language models have opened the door to culture-aware language tasks. |
| Approach: | They propose to integrate regional taste preferences and culture-specific flavor descriptors into wine reviews across Chinese and English. |
| Outcome: | The proposed model incorporates regional taste preferences and culture-specific flavor descriptors into the translation process. |
Understanding Cross-Lingual Alignment—A Survey (2024.findings-acl)
Copied to clipboard
| Challenge: | Cross-lingual alignment is the meaningful similarity of representations across languages in multilingual language models. |
| Approach: | They propose a taxonomy of methods to improve cross-lingual alignment . they argue that an effective trade-off between language-neutral and language-specific information is key . |
| Outcome: | The proposed methods can be applied to encoder models and encoder-decoder-only models . they show that language-neutral and language-specific information is key . |
Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | a large number of studies rely on closed-style multiple-choice surveys to evaluate cultural alignment in Large Language Models . however, these methods are constrained and lack nuanced and accurate evaluations based on specific cultural proxies. |
| Approach: | They propose to use the World Values Survey and Hofstede Cultural Dimensions as case studies to examine cultural alignment in Large Language Models. |
| Outcome: | The findings advocate for more robust evaluation frameworks that focus on cultural proxies. |
Research Borderlands: Analysing Writing Across Research Cultures (2025.acl-long)
Copied to clipboard
| Challenge: | a recent study has focused on improving cultural competence of language technologies, but most studies rely on synthetic setups and imperfect proxies of culture. |
| Approach: | They use a human-centered approach to discover and measure language-based cultural norms and cultural competence of large language models (LLMs). |
| Outcome: | The proposed framework identifies cultural norms that vary across research cultures and identifie a lack of cultural competence in LLMs. |
On Generalization across Measurement Systems: LLMs Entail More Test-Time Compute for Underrepresented Cultures (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) should be able to provide accurate information irrespective of the measurement system at hand . |
| Approach: | They use newly compiled datasets to test if this is true for seven open-source LLMs. |
| Outcome: | The proposed model can provide accurate information regardless of the measurement system at hand. |
OWL: Probing Cross-Lingual Recall of Memorized Texts via World Literature (2025.emnlp-main)
Copied to clipboard
Alisha Srivastava, Emir Kaan Korukluoglu, Minh Nhat Le, Duyen Tran, Chau Minh Pham, Marzena Karpinska, Mohit Iyyer
| Challenge: | Large language models (LLMs) are known to memorize and recall English text from their pretraining data, but the extent to which this ability generalizes to non-English languages or transfers across languages remains unclear. |
| Approach: | They propose a dataset of 31.5K aligned excerpts from 20 books in ten languages, including English originals, official translations and new translations in six low-resource languages. |
| Outcome: | The proposed model can recall English content in translations, but perturbations reduce performance, causing the model to fail. |
Challenges and Strategies in Cross-Cultural NLP (2022.acl-long)
Copied to clipboard
Daniel Hershcovich, Stella Frank, Heather Lent, Miryam de Lhoneux, Mostafa Abdou, Stephanie Brandl, Emanuele Bugliarello, Laura Cabello Piqueras, Ilias Chalkidis, Ruixiang Cui, Constanza Fierro, Katerina Margatina, Phillip Rust, Anders Søgaard
| Challenge: | Various efforts have been made to accommodate linguistic diversity and serve speakers of many different languages. |
| Approach: | They propose a framework to examine cultural differences in NLP to better serve users . they argue that cultural knowledge, preferences and values can affect NLP practices . |
| Outcome: | The proposed framework examines how cultural knowledge, preferences and values can affect NLP practices. |
Towards Measuring and Modeling “Culture” in LLMs: A Survey (2024.emnlp-main)
Copied to clipboard
Muhammad Adilazuarda, Sagnik Mukherjee, Pradhyumna Lavania, Siddhant Singh, Alham Aji, Jacki O’Neill, Ashutosh Modi, Monojit Choudhury
| Challenge: | Existing models are biased towards Western, Anglocentric or American cultures, a problem that is arguably detrimental to the performance of LLMs. |
| Approach: | They analyze more than 90 recent papers that aim to study cultural representation and inclusion in large language models. |
| Outcome: | The proposed models are biased towards Western, Anglocentric or American cultures, despite their diversity and their robustness. |
Analyzing LLMs’ Knowledge Boundary Cognition Across Languages Through the Lens of Internal Representations (2025.acl-long)
Copied to clipboard
| Challenge: | Understanding the knowledge boundaries of Large Language Models (LLMs) is crucial to prevent hallucination, but research on the knowledge boundary perceptions of LLMs has predominantly focused on English. |
| Approach: | They propose a training-free alignment method that effectively transfers knowledge boundary perception ability across languages, thereby helping reduce hallucination risk in low-resource languages. |
| Outcome: | The proposed method reduces hallucination risk in low-resource languages by fine-tuning on bilingual question pair translation. |
Carefully Considering Culture: Analyzing LLM Alignment in Single- and Multi-Cultural Settings using Cultural Consensus Theory (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent work in NLP has examined large language models for their understanding of cultural norms across countries, ignoring group consensus or possible multicultural environments. |
| Approach: | They apply cultural consensus theory to the World Values Survey to model multidimensional nuance by ignoring group consensus or over-regularizing consensus. |
| Outcome: | The proposed model misrepresents cultural structures by failing to form cohesive consensus or severely over-regularizing consensus. |