Papers by Haochuan Wang
UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Models (2024.emnlp-main)
Copied to clipboard
Zhanyue Qin, Haochuan Wang, Deyuan Liu, Ziyang Song, Cunhang Fan, Zhao Lv, Jinlin Wu, Zhen Lei, Zhiying Tu, Dianhui Chu, Xiaoyan Yu, Dianbo Sui
| Challenge: | Existing LLMs demonstrate powerful capabilities between tasks, but can they make sequential decisions? |
| Approach: | They propose to evaluate sequential decision-making capability of large language models (LLMs) using novel metrics based Monte Carlo methods. |
| Outcome: | The proposed benchmark improves sequential decision-making performance compared to the vanilla LLM player. |