Papers by Xihui Lin
A Practical Analysis of Human Alignment with *PO (2025.findings-naacl)
Copied to clipboard
| Challenge: | Prior research focused on identifying the best-performing method to varying hyperparameters . prior research focused primarily on a grid search, which can be impractical for general practitioners . |
| Approach: | They propose a preference optimization method that is more stable across hyperparameters and reduces the average response length. |
| Outcome: | The proposed method increases likelihood of achieving better results through various metrics, such as KL divergence and response length. |