Papers by Yitao Xiao
MobiLoRA: Accelerating LoRA-based LLM Inference on Mobile Devices via Context-aware KV Cache Optimization (2025.acl-long)
Copied to clipboard
| Challenge: | MobiLoRA focuses on optimizing the key-value (KV) caches due to the limited computing and memory resources of mobile devices. |
| Approach: | They propose to optimize the key-value caches due to limited computing resources . they propose similarity-aware delta encoding for semantic-level contexts . |
| Outcome: | The proposed model accelerates LoRA-based LLM inference by 57.6% on mobile devices. |
RouterHGC: Optimized Router for LLM-based Multi-Agent Systems via Heterogeneous Graph Contrastive Learning (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs)-driven Multi-Agent Systems (MAS) have demonstrated remarkable scalability and generalizability across complex tasks. |
| Approach: | They propose a new framework for routing using large language models . they formalize routing as node selection through edge-weight prediction . |
| Outcome: | The proposed framework outperforms the best single LLM and baselines on five datasets . it achieves 0.80%–6.17% accuracy gains on MATH and HotpotQA while reducing inference cost by 27.40%. |