Papers by Jegwang Ryu
Decoding with Limited Teacher Supervision Requires Understanding When to Trust the Teacher (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated their tremendous capability to generate human-like text sentences that convey rich knowledge in various problem domains. |
| Approach: | They propose an algorithm to aggregate small-scale LLM and LLM predictions on initial tokens so that the generated tokens can more accurately condition the subsequent token generation by small-level LLM only. |
| Outcome: | The proposed method improves on the limited supervision scenario on a wide range of models and datasets. |