Papers by Xingyuan Pan
Learning Constraints for Structured Prediction Using Rectifier Networks (2020.acl-main)
Copied to clipboard
| Challenge: | Various natural language processing tasks require domain expertise to design good constraints. |
| Approach: | They propose a framework for learning constraints in a network of linear inequalities over the output variables. |
| Outcome: | The proposed framework can be used to learn constraints from data on natural language processing tasks. |
ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting (2025.acl-long)
Copied to clipboard
Rui Pan, Dylan Zhang, Hanning Zhang, Xingyuan Pan, Minrui Xu, Jipeng Zhang, Renjie Pi, Xiaoyu Wang, Tong Zhang
| Challenge: | Existing paradigms for bilevel optimization require second-order information, making it difficult to scale them up. |
| Approach: | They propose a scalable instantiation of a bilevel optimization paradigm for large-scale LLMs by using a memory-efficient training technique. |
| Outcome: | The proposed paradigm scales to 30B-sized LLMs on 8H100 GPUs. |
COIG-P: A High-Quality and Large-Scale Chinese Preference Dataset for Alignment with Human Values (2026.findings-eacl)
Copied to clipboard
Siwei Wu, JinCheng Ren, Xeron Du, Shuyue Guo, Xingwei Qu, Yiming Liang, Jie Liu, Yunwen Li, Tyler Loakman, Tianyu Zheng, Boyu Feng, Huaqing Yuan, Zili Wang, Jiaheng Liu, Wenhao Huang, Chenglin Cai, Haoran Que, Jian Yang, Yuelin Bai, Zekun Moore Wang, Zhouliang Yu, Qunshu Lin, Ding Pan, Yuchen Eleanor Jiang, Tiannan Wang, Wangchunshu Zhou, Shenzhi Wang, Xingyuan Bu, Minghao Liu, Guoyin Wang, Ge Zhang, Chenghua Lin
| Challenge: | Existing Chinese preference datasets suffer from limited scale, restricted domain coverage, and insufficiently rigorous data validation. |
| Approach: | They propose an LLM-based data annotation pipeline with no human intervention to annotate Chinese preference datasets. |
| Outcome: | The proposed pipeline outperforms existing Chinese preference datasets on AlignBench and Chinese Reward Benchmark. |