S3-DST: Structured Open-Domain Dialogue Segmentation and State Tracking in the Era of LLMs (2024.findings-acl)
Copied to clipboard
Sarkar Snigdha Sarathi Das, Chirag Shah, Mengting Wan, Jennifer Neville, Longqi Yang, Reid Andersen, Georg Buscher, Tara Safavi
| Challenge: | Dialogue state tracking (DST) was based on narrow task-oriented conversations . however, large language models have ushered in more flexible open-domain chat systems . |
| Approach: | They propose a method that combines dialogue segmentation and state tracking within open-domain dialogues to improve long context tracking. |
| Outcome: | The proposed method outperforms the state-of-the-art on open-domain dialogue datasets and publicly available datasets. |
Similar Papers
Towards LLM-driven Dialogue State Tracking (2023.emnlp-main)
Copied to clipboard
| Challenge: | emergence of large language models (LLMs) such as GPT3 and ChatGPT has sparked considerable interest in assessing their efficacy across diverse applications. |
| Approach: | They present a framework for a domain-slot instruction tuning method that allows LDST to achieve performance on par with ChatGPT. |
| Outcome: | The proposed framework performs better in zero-shot and few-shot settings than previous SOTA methods. |
Beyond Single-User Dialogue: Assessing Multi-User Dialogue State Tracking Capabilities of Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have demonstrated remarkable performance in zero-shot dialogue state tracking (DST), reducing the need for task-specific training. |
| Approach: | They extend existing DST dataset by generating utterances of a second user based on speech act theory. |
| Outcome: | The proposed model incorporates utterances of a second user into conversations, enabling a controlled evaluation of LLMs in multi-user settings. |
ChatGPT for Zero-shot Dialogue State Tracking: A Solution or an Opportunity? (2023.acl-short)
Copied to clipboard
Michael Heck, Nurul Lubis, Benjamin Ruppik, Renato Vukovic, Shutong Feng, Christian Geishauser, Hsien-chin Lin, Carel van Niekerk, Milica Gasic
| Challenge: | Recent research on dialog state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas. |
| Approach: | They propose to use schema descriptions to facilitate zero-shot transfer to new domains . they argue that general purpose language models lack the ability to replace specialized systems . |
| Outcome: | The proposed method achieves state-of-the-art in zero-shot DST with in-context learning capabilities. |
GCDST: A Graph-based and Copy-augmented Multi-domain Dialogue State Tracking (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to training DST on a single domain ignore information across domains. |
| Approach: | They construct a dialogue state graph to transfer structured features among related domain-slot pairs across domains and encode the graph information of dialogue states by graph convolutional networks. |
| Outcome: | The proposed model improves the performance of the multi-domain DST baseline with the absolute joint accuracy of 2.0% and 1.0% on the MultiWOZ 2.0 and 2.1 dialogue datasets. |
Enhancing Dialogue State Tracking Models through LLM-backed User-Agents Simulation (2024.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that the model can be used to generate dialogues in new domains quickly. |
| Approach: | They propose to use LLMs to generate dialogue data to reduce dialogue collection and annotation costs. |
| Outcome: | The proposed model performs better than the baseline model trained on real data. |
Conversational Semantic Parsing for Dialog State Tracking (2020.emnlp-main)
Copied to clipboard
Jianpeng Cheng, Devang Agrawal, Héctor Martínez Alonso, Shruti Bhargava, Joris Driesen, Federico Flego, Dain Kaplan, Dimitri Kartsaklis, Lin Li, Dhivya Piraviperumal, Jason D. Williams, Hong Yu, Diarmuid Ó Séaghdha, Anders Johannsen
| Challenge: | Language understanding for task-based dialog systems is often termed "dialog state tracking" (DST) whereas semantic parsing is the task of converting a single-turn utterance to a graphstructured meaning representation, DST is more complex. |
| Approach: | They propose a framework for dialog state tracking that incorporates semantic compositionality, cross-domain knowledge sharing and co-reference. |
| Outcome: | The proposed framework improves on state-of-the-art approaches for dialog state tracking (DST) it incorporates semantic compositionality, cross-domain knowledge sharing and co-reference. |
A Zero-Shot Open-Vocabulary Pipeline for Dialogue Understanding (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches to DST are limited by their computational resources or lack flexibility to adapt to new slots. |
| Approach: | They propose a system that integrates domain classification and DST in a single pipeline and uses self-refining prompts to adapt dynamically. |
| Outcome: | The proposed system improves on existing methods on multiWOZ datasets and provides 20% better Joint Goal Accuracy (JGA) over existing methods with 90% fewer requests to the LLM API. |
Multi-Domain Dialogue State Tracking By Neural-Retrieval Augmentation (2022.findings-aacl)
Copied to clipboard
| Challenge: | Existing approaches for DST are conditioned on previous dialogue states, but the dependency on previous dialogs makes it difficult to prevent error propagation to subsequent turns. |
| Approach: | They propose to create a Neural Index based on dialogue context by analyzing user dialogue and previous turn state and generating a retrieval-guided generation approach. |
| Outcome: | The proposed framework retrieves dialogue context from the index built using unstructured dialogue state and structured user/system utterances. |
XQA-DST: Multi-Domain and Multi-Lingual Dialogue State Tracking (2023.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods for capturing dialogue data are expensive and limited in their application. |
| Approach: | They propose a domain-agnostic extractive question answering approach with shared weights across domains to disentangle complex domain information in ToDs. |
| Outcome: | The proposed model can efficiently leverage domain-agnostic QA datasets while being domain-scalable and open vocabulary in DST. |
Effective and Efficient Conversation Retrieval for Dialogue State Tracking with Implicit Text Summaries (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent studies use in-context learning with large language models (LLM) to find similar dialogue exemplars for prompt learning. |
| Approach: | They propose to use a conversation retriever to find similar in-context examples for prompt learning. |
| Outcome: | The proposed approach improves on multiWOZ datasets with GPT-Neo-2.7B and LLaMA-7B/30B . |