Papers by Deep Shah
Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning (2026.acl-industry)
Copied to clipboard
| Challenge: | Advanced reasoning typically requires Chain-of-Thought prompting, which is accurate but incurs prohibitive latency and substantial test-time inference costs. |
| Approach: | They propose to extract explicit reasoning patterns from a Teacher model and organize them into a structured list of expressive instructions for the Student model’s System Prompt. |
| Outcome: | Evaluated using Gemma-3 4B, the proposed model improves Macro F1 scores on StereoSet and Contract-NLI while increasing LogiQA accuracy to 70%. |