Papers by Saibo Geng
Grammar-Constrained Decoding for Structured NLP Tasks without Finetuning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing grammar-constrained decoding methods are limited to specific tasks . a grammar constraint is used to control the generation of LMs, but it is limited to a few tasks a task is not performed. |
| Approach: | They propose grammar-constrained decoding to control the generation of large language models . they demonstrate that grammars can describe the output space for a wider range of tasks . |
| Outcome: | The proposed grammars outperform unconstrained models on information extraction, entity disambiguation, and constituency parsing. |
Sketch-Guided Constrained Decoding for Boosting Blackbox Large Language Models without Logit Access (2024.acl-short)
Copied to clipboard
| Challenge: | Constrained decoding is a technique for enforcing constraints on language model outputs. |
| Approach: | They propose a technique for enforcing constraints on language model outputs . they propose auxiliary model that refines the initial output without constraints . |
| Outcome: | The proposed approach is able to refine the output of an unconstrained blackbox LLM without access to logits. |