Papers by Alexander Rakhlin
How Far Is Too Far? Studying the Effects of Domain Discrepancy on Masked Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Pre-trained masked language models perform strongly on a wide variety of NLP tasks. |
| Approach: | They propose a mechanism to quantify the difference in domains between the pre-trained model and the task and partition it using a cloze task. |
| Outcome: | The proposed model performs better on openly available e-commerce datasets than the original model on scientific and biomedical datasets. |