Papers by David Broman
Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programs (2024.emnlp-main)
Copied to clipboard
Krista Opsahl-Ong, Michael Ryan, Josh Purtell, David Broman, Christopher Potts, Matei Zaharia, Omar Khattab
| Challenge: | Language Model Programs (LMs) require crafting prompts that are jointly effective for all modules. |
| Approach: | They propose a novel algorithm for optimizing language model (LM) prompts for all modules by using program- and data-aware techniques and stochastic mini-batch evaluation functions. |
| Outcome: | The proposed algorithm outperforms baseline optimizers on five of seven diverse LM programs by as high as 13% accuracy. |