Papers by Yubin Qi
GAPO: Robust Advantage Estimation for Real-World Code LLMs (2026.findings-acl)
Copied to clipboard
Jianqing Zhang, Zhezheng Hao, Wei Xia, Hande Dong, Hong Wang, Chenxing Wei, Yuyan Zhou, Yubin Qi, Qiang Lin, Jian Cao
| Challenge: | Reinforcement learning (RL) is widely used for post-training large language models (LLMs) in code editing, but in real-world code editing scenarios, reward distributions are often skewed with unpredictable noise, leading to distorted advantage computation and increased rollout outliers. |
| Approach: | They propose a group-relative method that finds an interval with the highest SNR and uses the median of that interval as an adaptive Q to replace the group mean in advantage calculation. |
| Outcome: | The proposed method improves on nine instruction-tuned LLMs while remaining plug-and-play and efficient. |