Papers by Kabir Walia
Concept Distillation from Strong to Weak Models via Hypotheses-to-Theories Prompting (2025.naacl-industry)
Copied to clipboard
Emmanuel Aboah Boateng, Cassiano O Becker, Nabiha Asghar, Kabir Walia, Ashwin Srinivasan, Ehi Nosakhare, Soundararajan Srinivasan, Victor Dibia
| Challenge: | Concept Distillation (CD) is an automated prompt optimization technique for enhancing weaker models on complex tasks. |
| Approach: | They propose an automatic prompt optimization technique for enhancing weaker models on complex tasks using a base prompt and a strong model to generate reasons for these mistakes. |
| Outcome: | The proposed technique improves weaker models on NL2Code and mathematical reasoning tasks, while preserving performance. |