Papers by Ajwad Abrar
Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | a large number of studies rely on closed-style multiple-choice surveys to evaluate cultural alignment in Large Language Models . however, these methods are constrained and lack nuanced and accurate evaluations based on specific cultural proxies. |
| Approach: | They propose to use the World Values Survey and Hofstede Cultural Dimensions as case studies to examine cultural alignment in Large Language Models. |
| Outcome: | The findings advocate for more robust evaluation frameworks that focus on cultural proxies. |