Diable: Efficient Dialogue State Tracking as Operations on Tables (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing systems for dialogue state tracking use the full dialogue history as input and generate the entire state from scratch at each dialogue turn. |
| Approach: | They propose a task formalisation that represents the dialogue state as a table and formalises it as 'table manipulation task' they represent the dialogue as if it were a list with all the slots and generate the entire state from scratch at each dialogue turn. |
| Outcome: | The proposed system outperforms existing systems while maintaining competitive accuracy. |
Similar Papers
A Sequence-to-Sequence Approach to Dialogue State Tracking (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for dialogue state tracking are still challenging, but they are improving . a new approach to dialogue state monitoring is proposed, called Seq2Seq-DU . |
| Approach: | They propose a new dialogue state tracking module that formalizes DST as a sequence-to-sequence problem. |
| Outcome: | The proposed method outperforms existing methods on benchmark datasets in different settings. |
Beyond the Granularity: Multi-Perspective Dialogue Collaborative Selection for Dialogue State Tracking (2022.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that task-oriented dialogue systems have attracted growing attention and achieved substantial progress. |
| Approach: | They propose a method that dynamically selects relevant dialogue contents for each slot . they retrieve turn-level utterances and evaluate their relevance to the slot from three perspectives . |
| Outcome: | The proposed method achieves state-of-the-art performance on MultiWOZ 2.1 and MultiWOz 2.2 and superior performance on multiple mainstream benchmark datasets. |
Correctable-DST: Mitigating Historical Context Mismatch between Training and Inference for Improved Dialogue State Tracking (2022.emnlp-main)
Copied to clipboard
Hongyan Xie, Haoxiang Su, Shuangyong Song, Hao Huang, Bo Zou, Kun Deng, Jianghua Lin, Zhihui Zhang, Xiaodong He
| Challenge: | Existing dialogue state tracking approaches predict the dialogue state of a target turn sequentially based on the ground-truth previous dialogue state. |
| Approach: | They propose a method that predicts dialogue state sequentially based on previous dialogue state . they propose generating a previously “predicted” dialogue state using ground-truth previous dialogue states . |
| Outcome: | The proposed method achieves 67.51%, 68.24%, 70.30%, 71.38%, and 81.27% joint goal accuracy on MultiWOZ 2.0-2.4 datasets. |
Conversational Semantic Parsing for Dialog State Tracking (2020.emnlp-main)
Copied to clipboard
Jianpeng Cheng, Devang Agrawal, Héctor Martínez Alonso, Shruti Bhargava, Joris Driesen, Federico Flego, Dain Kaplan, Dimitri Kartsaklis, Lin Li, Dhivya Piraviperumal, Jason D. Williams, Hong Yu, Diarmuid Ó Séaghdha, Anders Johannsen
| Challenge: | Language understanding for task-based dialog systems is often termed "dialog state tracking" (DST) whereas semantic parsing is the task of converting a single-turn utterance to a graphstructured meaning representation, DST is more complex. |
| Approach: | They propose a framework for dialog state tracking that incorporates semantic compositionality, cross-domain knowledge sharing and co-reference. |
| Outcome: | The proposed framework improves on state-of-the-art approaches for dialog state tracking (DST) it incorporates semantic compositionality, cross-domain knowledge sharing and co-reference. |
Diverse and Effective Synthetic Data Generation for Adaptable Zero-Shot Dialogue State Tracking (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing zero-shot dialogue state tracking datasets are limited in the number of domains and slot types they cover due to the high costs of data collection. |
| Approach: | They propose a fully automatic approach that generates synthetic zero-shot dialogue state tracking datasets. |
| Outcome: | The proposed approach can generate dialogues across 1,000+ domains with silver-standard dialogue state annotations and slot descriptions. |
Improving Dialogue State Tracking with Turn-based Loss Function and Sequential Data Augmentation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models rely on a traditional cross-entropy loss function during training, which may not be optimal for improving the joint goal accuracy. |
| Approach: | They propose a Turn-based Loss Function that penalises the model if it inaccurately predicts a slot value at the early turns more so than in later turns to improve joint goal accuracy. |
| Outcome: | The proposed techniques improve the state-of-the-art model by approximately 7-8% relative reduction in error and achieve a new state- of-the art joint goal accuracy with 59.50 and 54.90 on MultiWOZ2.1 and MultiWOz2.2, respectively. |
GCDST: A Graph-based and Copy-augmented Multi-domain Dialogue State Tracking (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to training DST on a single domain ignore information across domains. |
| Approach: | They construct a dialogue state graph to transfer structured features among related domain-slot pairs across domains and encode the graph information of dialogue states by graph convolutional networks. |
| Outcome: | The proposed model improves the performance of the multi-domain DST baseline with the absolute joint accuracy of 2.0% and 1.0% on the MultiWOZ 2.0 and 2.1 dialogue datasets. |
Plan, Generate and Complicate: Improving Low-resource Dialogue State Tracking via Easy-to-Difficult Zero-shot Data Augmentation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing data augmentation methods rely on pre-defined user goals and neglect the importance of data complexity in this task. |
| Approach: | They propose an Easy-to-Difficult Zero-shot Data Augmentation framework for low-resource dialogue state tracking that utilizes large language models to automatically catch the relationships of different domains and then generate dialogue data. |
| Outcome: | The proposed framework outperforms existing methods on MultiWOZ and other similar datasets. |
Dialogue State Tracking with Explicit Slot Connection Modeling (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to track dialogue state are lacking in multi-domain scenarios. |
| Approach: | They propose a model that explicitly considers slot correlations across domains . they propose ellipsis and reference to express values that have been mentioned by slots from other domains. |
| Outcome: | The proposed model outperforms existing models on multi-domain datasets and achieves state-of-the-art performance. |
Scalable and Accurate Dialogue State Tracking via Hierarchical Sequence Generation (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to dialogue state tracking rely on pre-defined ontologies . however, these methods suffer from computational complexity that increases proportionally to the number of pre-determined slots. |
| Approach: | They propose a model that generates a sequence of belief states without the pre-defined ontology list. |
| Outcome: | The proposed model scales easily with the increasing number of pre-defined slots and domains and reaches the state-of-the-art performance on the multi-domain and single domain dialogue state tracking datasets. |