Papers by Sejoon Kim
REZE: Representation Regularization for Domain-adaptive Text Embedding Pre-finetuning (2026.acl-long)
Copied to clipboard
| Challenge: | Recent text embedding models often introduce task-induced bias alongside domain knowledge, leading to performance degradation. |
| Approach: | They propose a representation regularization framework that explicitly controls representation shift during embedding pre-finetuning. |
| Outcome: | The proposed framework outperforms standard pre-finetuning and isotropy-oriented post-hoc regularization in most settings. |