Papers by Alisha Srivastava
OWL: Probing Cross-Lingual Recall of Memorized Texts via World Literature (2025.emnlp-main)
Copied to clipboard
Alisha Srivastava, Emir Kaan Korukluoglu, Minh Nhat Le, Duyen Tran, Chau Minh Pham, Marzena Karpinska, Mohit Iyyer
| Challenge: | Large language models (LLMs) are known to memorize and recall English text from their pretraining data, but the extent to which this ability generalizes to non-English languages or transfers across languages remains unclear. |
| Approach: | They propose a dataset of 31.5K aligned excerpts from 20 books in ten languages, including English originals, official translations and new translations in six low-resource languages. |
| Outcome: | The proposed model can recall English content in translations, but perturbations reduce performance, causing the model to fail. |