Papers by Berkay Döner
Sketch-Guided Constrained Decoding for Boosting Blackbox Large Language Models without Logit Access (2024.acl-short)
Copied to clipboard
| Challenge: | Constrained decoding is a technique for enforcing constraints on language model outputs. |
| Approach: | They propose a technique for enforcing constraints on language model outputs . they propose auxiliary model that refines the initial output without constraints . |
| Outcome: | The proposed approach is able to refine the output of an unconstrained blackbox LLM without access to logits. |