Papers by Jiamu Zhou
HammerBench: Fine-Grained Function-Calling Evaluation in Real Mobile Assistant Scenarios (2025.findings-acl)
Copied to clipboard
Jun Wang, Jiamu Zhou, Xihuai Wang, Xiaoyun Mo, Haoyu Zhang, Qiqiang Lin, Jincheng Jincheng, Muning Wen, Weinan Zhang, Qiuying Peng, Jun Wang
| Challenge: | Evaluating the performance of LLMs in multi-turn interactions presents significant challenges due to the complexity and variability of user behavior. |
| Approach: | They propose a benchmark framework for assessing LLMs’ function-calling capabilities in multi-turn dialogues. |
| Outcome: | The proposed framework is based on a dataset derived from popular mobile apps and anonymized user logs. |
ColorBrowserAgent: Complex Long-Horizon Browser Agent with Adaptive Knowledge Evolution (2026.acl-industry)
Copied to clipboard
Jihong Wang, Jiamu Zhou, Weiming Zhang, Teng Wang, Weiwen Liu, Zhuosheng Zhang, Xingyu Lou, Weinan Zhang, Huarong Deng, Jun Wang
| Challenge: | Xue et al., 2025): deploying autonomous web agents in production remains difficult due to site heterogeneity and long-horizon instability. |
| Approach: | They propose a knowledge-evolving agent that can be used to automate web workflows . they use human-in-the-loop knowledge adaptation and knowledge-aligned progressive summarization . |
| Outcome: | Experiments on WebArena, WebChoreAren and industrial deployment show it outperforms baselines. |