Papers by Shufan Chen
When and How to Augment Your Input: Question Routing Helps Balance the Accuracy and Efficiency of Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | augmented generation of knowledge-based long-tail questions can be useful for large language models, but can cause significant latency. |
| Approach: | They propose an adaptive question routing framework that uses a query router to augment input to the right time. |
| Outcome: | The proposed framework surpasses existing approaches in accuracy and efficiency on benchmarks such as AmbigNQ, HotpotQA, MMLU-STEM, and PopQA. |