Papers by Rushikesh Pawar
What Question Did You Answer? Refining Contact Center Evaluation Plans via Backward Questions (2026.acl-industry)
Copied to clipboard
| Challenge: | Recent advances in large Language Models (LMs) offer unprecedented potential for automating QA evaluations . however, capturing organization-specific domain knowledge remains a challenge for cost-efficient language models . |
| Approach: | They propose a diagnostic framework that generates backward questions to distill implicit reasoning from large LMs into explicit evaluation plans. |
| Outcome: | The proposed framework achieves performance improvements on 8 QA questions with gains of 27.8% in Macro F1. |