Papers by Tianle Cui
PlanningArena: A Modular Benchmark for Multidimensional Evaluation of Planning and Tool Learning (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that LLMs can be significantly improved by integrating external tools. |
| Approach: | They propose a framework that integrates external tools into large language models to evaluate their ability to generate action plans. |
| Outcome: | The proposed framework evaluates the ability of large language models to generate action plans and generate action plan templates. |
NaturalGAIA: A Verifiable Benchmark and Hierarchical Framework for Long-Horizon GUI Tasks (2026.acl-long)
Copied to clipboard
| Challenge: | Current research faces an "Evaluation-Realism Dilemma" due to unstable MLLM judges or manual verification. |
| Approach: | They propose a verifiable evaluation dataset grounded in real-world human GUI intents. |
| Outcome: | The proposed framework outperforms the state-of-the-art framework in achieving a weighted pathway success rate of 45.6% while reducing token consumption and execution time by 76%. |