Papers by Adam Dziedzic
Pretrained Transformers Improve Out-of-Distribution Robustness (2020.acl-main)
Copied to clipboard
| Challenge: | Pretrained Transformers are more effective at detecting anomalous or OOD examples, while many previous models are frequently worse than chance. |
| Approach: | They construct a new robustness benchmark with real distribution shifts to measure out-of-distribution generalization for seven NLP datasets and compare them to previous models. |
| Outcome: | The proposed model generalizations for seven datasets show that pretrained Transformers are significantly less effective at detecting anomalous or OOD examples, while many previous models are often worse than chance. |