Papers with CAMeL-2
On The Origin of Cultural Biases in Language Models: From Pre-training Data to Linguistic Phenomena (2025.naacl-long)
Copied to clipboard
| Challenge: | Language Models (LMs) have been shown to exhibit a strong preference towards entities associated with Western culture when operating in non-Western languages. |
| Approach: | They propose a parallel Arabic-English benchmark of 58,086 entities associated with Arab and Western cultures and 367 masked natural contexts for entities. |
| Outcome: | The proposed model shows that LMs struggle in Arabic with entities that appear at high frequencies in pre-training, where entities can hold multiple word senses. |