Papers with point-in-time
Time Machine GPT (2024.findings-naacl)
Copied to clipboard
| Challenge: | Large language models are often trained on extensive, temporally indiscriminate text corpora . conventional methods for creating temporal adapted models depend on pre-training static models on time-specific data. |
| Approach: | They propose a series of point-in-time LLMs called TimeMachineGPT to be nonprognosticative . time-series forecasting and event prediction aim to infer a future state from past data . authors propose linguistically-based models that can be used to predict future events . |
| Outcome: | The proposed model is nonprognosticative and ensures it remains uninformed about future factual information and linguistic changes. |