Papers by MiHyeon Kim
IM-BERT: Enhancing Robustness of BERT through the Implicit Euler Method (2024.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained Language Models (PLMs) have shown remarkable performance on diverse NLP tasks through pre-training and fine-tuning. |
| Approach: | They propose a numerically robust IM-connection incorporating a layer of BERT as a solution of Ordinary Differential Equations (ODEs) . Experimental results validate the robustness of IM BERT under various conditions. |
| Outcome: | The proposed model outperforms the existing model on the adversarial GLUE dataset by 5.9%p on low-resource scenarios. |
Before Forgetting, Learn to Remember: Revisiting Foundational Learning Failures in LVLM Unlearning Benchmarks (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) are capable of learning from vast webscale datasets but pose privacy risks as they can unintentionally memorize sensitive information. |
| Approach: | They propose a Reliable Multi-hop and Multi-image Memorization Benchmark that ensures robust foundational learning through principled data scaling and reasoning-aware QA pairs. |
| Outcome: | Extensive experiments show that ReMem provides a reliable framework for diagnosing both learning and unlearning behaviors in Large Vision-Language Models. |
See-Saw Modality Balance: See Gradient, and Sew Impaired Vision-Language Balance to Mitigate Dominant Modality Bias (2025.naacl-long)
Copied to clipboard
| Challenge: | Vision-language models often rely on a single modality rather than treating and utilizing them equally, leading to dominance of a specific modality on the overall performance. |
| Approach: | They propose a framework to mitigate dominant modality bias by adjusting the gradient of KL divergence based on each modality's contribution and aligning task directions in a non-conflicting manner. |
| Outcome: | The proposed framework mitigates dominant modality bias on UPMC Food-101, Hateful Memes, and MM-IMDb datasets. |