Papers by Juhyoung Park
IM-BERT: Enhancing Robustness of BERT through the Implicit Euler Method (2024.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained Language Models (PLMs) have shown remarkable performance on diverse NLP tasks through pre-training and fine-tuning. |
| Approach: | They propose a numerically robust IM-connection incorporating a layer of BERT as a solution of Ordinary Differential Equations (ODEs) . Experimental results validate the robustness of IM BERT under various conditions. |
| Outcome: | The proposed model outperforms the existing model on the adversarial GLUE dataset by 5.9%p on low-resource scenarios. |