Papers by Ramamohan Kummara
Towards Fair Evaluation of Dialogue State Tracking by Flexible Incorporation of Turn-level Performances (2022.acl-short)
Copied to clipboard
| Challenge: | Dialogue State Tracking (DST) is a task-oriented conversational agent that keeps track of key information exchanged during a conversation. |
| Approach: | They propose a new evaluation metric called Flexible Goal Accuracy to address shortcomings of JGA. |
| Outcome: | The proposed metric improves on existing metrics and improves performance of turn-level and non-cumulative belief state models. |