Papers by Steven Kolawole
Semantic Agreement Enables Efficient Open-Ended LLM Cascades (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Large language models (LLMs) have enabled impressive progress across a range of language tasks, but they are steep computational cost. |
| Approach: | They propose a semantic consensus mechanism for reliable deferral by combining model outputs with semantic consensus. |
| Outcome: | Evaluated from 500M to 70B-parameter models, semantic cascades improve deferral accuracy, match or surpass target-model quality at 40% of the cost and reduce latency by up to 60%. |