Papers by Dongheng Li
LLMR: Knowledge Distillation with a Large Language Model-Induced Reward (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models have demonstrated remarkable performance in various NLP tasks, but are typically computationally expensive and difficult to be deployed in resource-constrained environments. |
| Approach: | They propose a knowledge distillation method based on a reward function induced from large language models. |
| Outcome: | The proposed method outperforms traditional methods on multiple datasets and tasks. |