Papers by Kai Nylund
Time is Encoded in the Weights of Finetuned Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Time vectors are used to customize language models to new time periods. |
| Approach: | They propose a tool to customize language models to new time periods by using time vectors . they show that time is encoded in the weight space of finetuned models . |
| Outcome: | The proposed tool improves performance on text from a time period without training. |