Papers by Margret Keuper
Balancing Diversity and Risk in LLM Sampling: How to Select Your Method and Parameter for Open-Ended Text Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies suggest that sampling-based decoding strategies can be used to optimize the output of Large Language Models (LLMs) . previous studies have shown that likelihood-maximization produces degenerate text which contains repetitive loops and incoherent context, especially in open-ended tasks. |
| Approach: | They propose to use a prefix tree to estimate the intrinsic capacity of a truncation sampling method by considering the trade-off between diversity and risk at each decoding step. |
| Outcome: | The proposed method is based on a prefix tree which preserves the context of a full sentence. |