Papers by Anupam Samanta
QUILL: Query Intent with Large Language Models using Retrieval Augmentation and Multi-stage Distillation (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown impressive results on a variety of text understanding tasks. |
| Approach: | They propose a two-stage distillation approach that allows retrieval augmentation to be carried over without the increased compute associated with it. |
| Outcome: | The proposed approach can carry over the gains of retrieval augmentation without suffering the increased compute typically associated with it. |