Large Language Models as Zero-shot Dialogue State Tracker through Function Calling (2024.acl-long)
Copied to clipboard
Zekun Li, Zhiyu Chen, Mike Ross, Patrick Huber, Seungwhan Moon, Zhaojiang Lin, Xin Dong, Adithya Sagar, Xifeng Yan, Paul Crook
| Challenge: | Large language models (LLMs) are increasingly prevalent in conversational systems due to their advanced understanding and generative capabilities in general contexts. |
| Approach: | They propose a method for solving dialogue state tracking (DST) with large language models through function calling. |
| Outcome: | The proposed approach improves zero-shot DST, allowing adaptation to diverse domains without extensive data collection or model tuning. |
Similar Papers
Towards LLM-driven Dialogue State Tracking (2023.emnlp-main)
Copied to clipboard
| Challenge: | emergence of large language models (LLMs) such as GPT3 and ChatGPT has sparked considerable interest in assessing their efficacy across diverse applications. |
| Approach: | They present a framework for a domain-slot instruction tuning method that allows LDST to achieve performance on par with ChatGPT. |
| Outcome: | The proposed framework performs better in zero-shot and few-shot settings than previous SOTA methods. |
ChatGPT for Zero-shot Dialogue State Tracking: A Solution or an Opportunity? (2023.acl-short)
Copied to clipboard
Michael Heck, Nurul Lubis, Benjamin Ruppik, Renato Vukovic, Shutong Feng, Christian Geishauser, Hsien-chin Lin, Carel van Niekerk, Milica Gasic
| Challenge: | Recent research on dialog state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas. |
| Approach: | They propose to use schema descriptions to facilitate zero-shot transfer to new domains . they argue that general purpose language models lack the ability to replace specialized systems . |
| Outcome: | The proposed method achieves state-of-the-art in zero-shot DST with in-context learning capabilities. |
A Zero-Shot Open-Vocabulary Pipeline for Dialogue Understanding (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing approaches to DST are limited by their computational resources or lack flexibility to adapt to new slots. |
| Approach: | They propose a system that integrates domain classification and DST in a single pipeline and uses self-refining prompts to adapt dynamically. |
| Outcome: | The proposed system improves on existing methods on multiWOZ datasets and provides 20% better Joint Goal Accuracy (JGA) over existing methods with 90% fewer requests to the LLM API. |
Semantic Parsing by Large Language Models for Intricate Updating Strategies of Zero-Shot Dialogue State Tracking (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for zero-shot Dialogue State Tracking have focused on domaintransfers and have not yielded satisfactory results. |
| Approach: | They propose a new In-Context Learning method to introduce additional updating strategies in zero-shot DST by leveraging powerful Large Language Models and translating the original dialogue to JSON through semantic parsing as an intermediate state. |
| Outcome: | The proposed method outperforms existing zero-shot DST methods on MultiWOZ, showing significant improvements in JGA and slot accuracy compared to existing methods. |
Beyond Single-User Dialogue: Assessing Multi-User Dialogue State Tracking Capabilities of Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have demonstrated remarkable performance in zero-shot dialogue state tracking (DST), reducing the need for task-specific training. |
| Approach: | They extend existing DST dataset by generating utterances of a second user based on speech act theory. |
| Outcome: | The proposed model incorporates utterances of a second user into conversations, enabling a controlled evaluation of LLMs in multi-user settings. |
Effective and Efficient Conversation Retrieval for Dialogue State Tracking with Implicit Text Summaries (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent studies use in-context learning with large language models (LLM) to find similar dialogue exemplars for prompt learning. |
| Approach: | They propose to use a conversation retriever to find similar in-context examples for prompt learning. |
| Outcome: | The proposed approach improves on multiWOZ datasets with GPT-Neo-2.7B and LLaMA-7B/30B . |
S3-DST: Structured Open-Domain Dialogue Segmentation and State Tracking in the Era of LLMs (2024.findings-acl)
Copied to clipboard
Sarkar Snigdha Sarathi Das, Chirag Shah, Mengting Wan, Jennifer Neville, Longqi Yang, Reid Andersen, Georg Buscher, Tara Safavi
| Challenge: | Dialogue state tracking (DST) was based on narrow task-oriented conversations . however, large language models have ushered in more flexible open-domain chat systems . |
| Approach: | They propose a method that combines dialogue segmentation and state tracking within open-domain dialogues to improve long context tracking. |
| Outcome: | The proposed method outperforms the state-of-the-art on open-domain dialogue datasets and publicly available datasets. |
Call, Reward, Repeat: Advancing Dialog State Tracking with GRPO and Function Calling (2026.eacl-srw)
Copied to clipboard
| Challenge: | Recent advances in Large Language Models (LLMs) have notably enhanced task-oriented dialogue systems, particularly in Dialogue State Tracking (DST). |
| Approach: | They propose a group-relative policy optimization method that guides LLMs toward improved DST accuracy even under low-resource conditions. |
| Outcome: | The proposed method improves on established DST benchmarks while using significantly reduced out-of-domain training data. |
Revisiting Large Language Models as Zero-shot Relation Extractors (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies show that large language models (LLMs) transfer well to new tasks out-of-the-box . relationship extraction (RE) involves a certain degree of labeled or unlabeled data even under zero-shot setting. |
| Approach: | They propose a simple prompt recursively using LLMs to transform RE inputs to QA format . they propose qq prompting and qt prompting to improve their results . |
| Outcome: | The proposed method improves on different model sizes, benchmarks and settings. |
Zero-Shot Spoken Language Understanding via Large Language Models: A Preliminary Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have shown promising results in zero-shot settings, which motivates us to explore prompt-based methods. |
| Approach: | They propose a two-stage framework which transforms the SLU task into a question-answering problem by directly prompting LLMs. |
| Outcome: | The proposed framework can be built by directly prompting LLMs to understand user needs without training data. |