Papers by Xiaosen Zheng
An Empirical Study of Memorization in NLP (2022.acl-long)
Copied to clipboard
| Challenge: | Existing studies see memorization as hindering generalization in deep learning models. |
| Approach: | They propose a long-tail theory to explain the memorization behavior of deep learning models . they use three different NLP tasks to test whether the theory holds . |
| Outcome: | The proposed long-tail theory is validated in three NLP tasks and shows it is faithful. |