Papers by Seonwu Kim
ixi-GEN: Efficient Industrial sLLMs through Domain Adaptive Continual Pretraining (2025.emnlp-industry)
Copied to clipboard
Seonwu Kim, Yohan Na, Kihun Kim, Hanhee Cho, Geun Lim, Mintae Kim, Seongik Park, Ki Hyun Kim, Youngsub Han, Byoung-Ki Jeon
| Challenge: | Domain Adaptive Continual Pretraining (DACP) is a method to mitigate performance degradation in small LLMs and enhance their effectiveness in target domains. |
| Approach: | They propose a continual pretraining methodology that optimizes sLLMs within service domains and enhances their effectiveness in target domains. |
| Outcome: | The proposed model achieves significant gains in target-domain performance while preserving general capabilities, offering a cost-efficient and scalable solution for enterprise-level deployment. |