Papers by SangMook Kim
BAPO: Base-Anchored Preference Optimization for Overcoming Forgetting in Large Language Models Personalization (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to align Large Language Models with human preferences fail to maintain general knowledge and alignment when faced with personalized preferences. |
| Approach: | They propose a method that utilizes the initial responses of the reference model to mitigate forgetting while accommodating personalized alignment. |
| Outcome: | The proposed approach mitigates forgetting while accommodating personalized alignment while preserving global knowledge and general alignment. |