Papers by Sanket Shah
Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning (2026.acl-industry)
Copied to clipboard
| Challenge: | Advanced reasoning typically requires Chain-of-Thought prompting, which is accurate but incurs prohibitive latency and substantial test-time inference costs. |
| Approach: | They propose to extract explicit reasoning patterns from a Teacher model and organize them into a structured list of expressive instructions for the Student model’s System Prompt. |
| Outcome: | Evaluated using Gemma-3 4B, the proposed model improves Macro F1 scores on StereoSet and Contract-NLI while increasing LogiQA accuracy to 70%. |
CoSSAT: Code-Switched Speech Annotation Tool (D19-59)
Copied to clipboard
| Challenge: | Code-switching is a phenomenon that occurs in multilingual societies where speakers who are fluent in two or more languages switch between these languages in the same conversation or utterance. |
| Approach: | They propose an interface which helps annotators transcribe code-switched speech faster, more easily and more accurately than a traditional interface. |
| Outcome: | The proposed interface can be used by 10 users to transcribe Hindi-English code-switched speech faster, easier and more accurately than a traditional interface. |