Papers by Charlotte Collins
Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models (2022.acl-long)
Copied to clipboard
| Challenge: | Despite the growing progress of probing knowledge for pre-trained language models, specialised areas such as the biomedical domain are vastly under-explored. |
| Approach: | They propose a biomedical knowledge probing benchmark, MedLAMA, constructed based on the Unified Medical Language System (UMLS) Metathesaurus. |
| Outcome: | The proposed approach pushes the acc@10 to 28%, but the performance gap remains notable. |