Papers by Akshay Shekher
Dynamic Strategy Planning for Efficient Question Answering with Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies have shown that using a single fixed strategy for answering all different kinds of questions is sub-optimal in performance and inefficient in terms of generated tokens and retrievals. |
| Approach: | They propose a technique to induce a dynamic strategy selection process in Large Language Models (LLMs) by incorporating an initial decision step to select the most suitable strategy conditioned on the input question and guides the LLM’s response generation accordingly. |
| Outcome: | The proposed technique improves model performance by 7-13% while reducing the cost by 11-32% relative to the best baseline model. |