Papers by Ian Bulovic
Using tournaments to calculate AUROC for zero-shot classification with LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models perform well on zero-shot classification tasks, but are difficult to compare to supervised classifiers due to the lack of a modifiable decision boundary. |
| Approach: | They propose a method that transforms binary classification tasks into pairwise comparisons between instances within a dataset. |
| Outcome: | The proposed method produces relative rankings of instances using the Elo rating system . |