Papers by Constantinos Papayiannis
Hearing Between the Lines: Unlocking the Reasoning Power of LLMs for Speech Evaluation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Model (LLM) judges are limited to textual content, resulting in expensive and opaque evaluation methods. |
| Approach: | They propose a framework that enables large language model judges to reason over audio cues . they introduce a human chain-of-thought annotation protocol to improve judge diagnostic capability . |
| Outcome: | The proposed framework achieves higher agreement with human raters than ALMs and transcript-only LLM judges while being significantly more cost-effective. |