Papers by Craig Messner
Pretraining Language Models for Diachronic Linguistic Change Discovery (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models are increasingly used as knowledge discovery tools . historical linguistics and literary studies often construct arguments on the basis of distinctions between phenomena like time-period or genre. |
| Approach: | They propose to use LLMs to train large language models over modest historical corpora without allowing contamination from anachronistic data. |
| Outcome: | The proposed model better respects historical divisions and is more computationally efficient compared to the standard approach of fine-tuning an existing LLM. |