Papers by Kaushik Sadagopan
Know Thy Strengths: Comprehensive Dialogue State Tracking Diagnostics (2022.findings-emnlp)
Copied to clipboard
Hyundong Cho, Chinnadhurai Sankar, Christopher Lin, Kaushik Sadagopan, Shahin Shayandeh, Asli Celikyilmaz, Jonathan May, Ahmad Beirami
| Challenge: | Recent studies have revealed the vulnerability of dialogue state tracking models to distributional shifts, resulting in poor performance. |
| Approach: | They present a toolkit for standardized and comprehensive dialogue state tracking diagnoses that provides a richer summary of strengths and weaknesses. |
| Outcome: | The proposed toolkit shows that different classes of DST models have clear strengths and weaknesses, while generation models are more promising for handling language variety and span-based classification models are robust to unseen entities. |