Papers by Anurag Mudgil
Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries (2025.emnlp-main)
Copied to clipboard
| Challenge: | a typical human-assistant conversation is lengthy and shows significant diversity in topics, intents, and requirements across turns. |
| Approach: | They propose a framework that leverages pertinent linguistic concepts of dialog-acts and maxims to improve the accuracy of LLM-judges on preference data with complex, multi-turn conversational context. |
| Outcome: | The proposed framework improves on 4 challenging datasets showing that humans frequently change their intents from one turn of the conversation to the next. |