Papers by Junghyun Min
Syntactic Data Augmentation Increases Robustness to Inference Heuristics (2020.acl-main)
Copied to clipboard
| Challenge: | Pretrained neural models lack sensitivity to word order on controlled challenge sets . augmentation methods that improve accuracy on standard training sets may be a problem . |
| Approach: | They propose to augment standard training sets with syntactically informative examples by applying syntastic transformations to sentences from the MNLI corpus. |
| Outcome: | The proposed method improved BERT’s accuracy on controlled examples that diagnose sensitivity to word order from 0.28 to 0.73 without affecting performance on the MNLI test set. |