Papers by Tony Quek
Global Adaptive Momentum Meets Local Personalized Perturbation: Efficient Federated LLM Fine-Tuning with Zeroth-Order Gradients (2026.acl-long)
Copied to clipboard
| Challenge: | federated fine-tuning of large language models provides privacy-preserving approach to deploying pervasive generative AI services. |
| Approach: | They propose a federated framework for fine-tuning large language models . they propose unified optimization and local personalized perturbation for ZO gradients . |
| Outcome: | The proposed framework outperforms existing methods for integrating ZO gradients in federated learning over diverse heterogeneous data settings. |
DiffPO: Diffusion-styled Preference Optimization for Inference Time Alignment of Large Language Models (2025.acl-long)
Copied to clipboard
Ruizhe Chen, Wenhao Chai, Zhifei Yang, Xiaotian Zhang, Ziyang Wang, Tony Quek, Joey Tianyi Zhou, Soujanya Poria, Zuozhu Liu
| Challenge: | Inference-time alignment approaches still face limitations due to policy-specific value functions and latency during the inference phase. |
| Approach: | They propose an efficient and policy-agnostic preference optimization method that avoids time latency associated with token generation. |
| Outcome: | The proposed method achieves a favorable trade-off between alignment quality and inference-time latency. |