Papers by Yuezhang Peng
MUZO: Leveraging Multiple Queries and Momentum for Zeroth-Order Fine-Tuning of Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fine-tuning large language models incur memory overhead due to the need for activation storage for back-propagation (BP). |
| Approach: | They propose a method that estimates gradients through finite differences without activation storage for back-propagation. |
| Outcome: | The proposed method demonstrates superior performance in fine-tuning various LLMs. |
Evolving Agentic Workflow Driven by Human-Agent Collaboration (2026.findings-acl)
Copied to clipboard
Yuxin Liu, Jinxuan Zhang, Yuezhang Peng, Hefeng Zhou, Xiangfeng Wang, Jiong Lou, Chentao Wu, Jie LI, Jingjing Qu, Chaochao Lu
| Challenge: | Existing approaches to generate agentic workflows using large language models are limited by high manual design costs, inefficient agentic search, and poor dynamic adaptability to new tasks and human preferences. |
| Approach: | They propose an evolutionary framework for generating agentic workflows through human-agent collaboration using evolutionary algorithms that mutate and cross over their structures, prompts, and LLM backbones. |
| Outcome: | The proposed framework surpasses other automated baselines by 27.34% while achieving comparable performance to o1-preview at only one-fourth of the cost. |