Papers by Peijia Zheng
Intrinsic Mutual Information as a Modulator for Preference Optimization (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for offline preference optimization involve additional hyperparameter tuning, resulting in substantial time overhead. |
| Approach: | They propose a lightweight framework for offline preference optimization that leverages hyperparameter modulation to decouple preference contributions. |
| Outcome: | The proposed framework achieves superior performance over existing methods while reducing training overhead by more than 15%. |