Papers by Louise Naudin
Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoning (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for solving common NLP tasks rely on fine-tuning of pre-trained transformer models. |
| Approach: | They propose a scoring method that casts a plausibility ranking task in full-text format without fine-tuning . they use masked language modeling head tuned during pre-training phase to exploit this method . |
| Outcome: | The proposed method produces strong baselines comparable to supervised approaches. |