Papers by Yulun Zhang
SGDPO: Self-Guided Direct Preference Optimization for Language Model Alignment (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for aligning Large Language Models with human values are limited and results of DPO are not resilient. |
| Approach: | They propose a self-guided direct preference optimization algorithm that incorporates a pilot term to steer the gradient flow during the optimization process. |
| Outcome: | The proposed method can generate human-preferred response up to 9.19% higher than previous methods. |
CARFT: Boosting LLM Reasoning via Contrastive Learning with Annotated Chain-of-Thought-based Reinforced Fine-Tuning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to improve the reasoning performance of Large Language Models (LLMs) ignore annotated Chain-of-Thought (CoT) and incorporate unstable reasoning path sampling. |
| Approach: | They propose a Contrastive learning with annotated CoT-based Reinforced Fine-Tuning approach to enhance the reasoning performance of Large Language Models. |
| Outcome: | The proposed approach exploits annotated CoT and stabilizes the fine-tuning procedure by incorporating an additional unsupervised learning signal. |