Papers by Vaden Masrani
GOLD: Generalized Knowledge Distillation via Out-of-Distribution-Guided Language Data Generation (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to generate data using LLMs are limited by sampling from the center of original content distribution. |
| Approach: | They propose a task-agnostic data generation and knowledge distillation framework for LLMs that employs an iterative out-of-distribution-guided feedback mechanism to generate data. |
| Outcome: | The proposed framework outperforms prior arts and the LLM on 10 different classification tasks and noisey generated data. |