Papers by Gaoxiang Luo
COM-BOM: Bayesian Exemplar Search for Efficiently Exploring the Accuracy-Calibration Pareto Frontier (2025.emnlp-main)
Copied to clipboard
| Challenge: | Prior exemplar selection methods focus on maximizing predictive accuracy, neglecting model calibration. |
| Approach: | They propose to use a Bayesian optimization algorithm to optimize for predictive accuracy and calibration. |
| Outcome: | The proposed algorithm beats or matches baselines on multiple tasks from un-saturated MMLU-pro benchmarks while requiring minimal number of API calls. |