Papers by Kaiwen Shi
AgentRouter: A Knowledge-Graph-Guided LLM Router for Collaborative Multi-Agent Question Answering (2026.acl-long)
Copied to clipboard
Zheyuan Zhang, Kaiwen Shi, Zhengqing Yuan, Zehong Wang, Tianyi Ma, Keerthiram Murugesan, Vincent Galassi, Chuxu Zhang, Yanfang Ye
| Challenge: | Existing approaches to agent routing emphasize cost efficiency while overlooking the fine-grained contextual and relational structure inherent in QA tasks. |
| Approach: | They propose a framework that formulates multi-agent QA as a knowledge-graph-guided routing problem supervised by empirical performance signals. |
| Outcome: | The proposed framework outperforms single-agent and ensemble baselines while generalizing across benchmarks and LLM backbones. |
FormulaReasoning: A Dataset for Formula-Based Numerical Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets for numerical reasoning often lack explicit knowledge of formulas . current datasets do not provide process supervision information, resulting in incomplete reasoning . |
| Approach: | They propose a benchmark for formula-based numerical reasoning with 5,324 questions . they provide annotations in English and Chinese and a formula database as an external knowledge source . |
| Outcome: | The proposed model includes 5,324 questions requiring calculations grounded in external physics principles. |
NG-Router: Graph-Supervised Multi-Agent Collaboration for Nutrition Question Answering (2026.eacl-long)
Copied to clipboard
Kaiwen Shi, Zheyuan Zhang, Zhengqing Yuan, Keerthiram Murugesan, Vincent Galassi, Chuxu Zhang, Yanfang Ye
| Challenge: | Existing methods for nutrition question answering face limited reasoning capacity and contextual overload . poor dietary patterns are associated with more than 11 million deaths in 2017 . |
| Approach: | They propose a framework that enables supervised multi-agent collaboration for nutritional QA. |
| Outcome: | The proposed framework outperforms single-agent and ensemble baselines in multi-agency reasoning tasks. |
CodeIF: Benchmarking the Instruction-Following Capabilities of Large Language Models for Code Generation (2025.acl-industry)
Copied to clipboard
| Challenge: | CodeIF assesses the ability of large language models to adhere to task-oriented instructions in code generation tasks. |
| Approach: | They introduce a benchmark designed to assess LLMs' ability to adhere to task-oriented instructions within diverse code generation scenarios. |
| Outcome: | The proposed benchmark assesses LLMs' ability to adhere to task-oriented instructions in code generation tasks across a wide range of complexity levels and programming domains. |