Challenge: Slot Schema Induction (SSI) is a task-oriented dialogue (TOD) system that allows for automatic identification of information slots from unlabeled data.
Approach: They propose a language model that incrementally constructs and refines a slot schema over a stream of dialogue data and then automatically creates high-quality state labels.
Outcome: The proposed method creates high-quality state labels for novel task domains and improves evaluation metrics.

Similar Papers

Unsupervised Slot Schema Induction for Task-oriented Dialog (2022.naacl-main)

Copied to clipboard

Challenge: Defining task-specific schemas is the first step of building a task-oriented dialog system.
Approach: They propose an unsupervised approach for slot schema induction from unlabeled dialog corpora using in-domain language models and unsupervised parsing structures.
Outcome: The proposed method shows significant performance improvement on multi-domain and SGD datasets.
Dialogue State Tracking with a Language Model using Schema-Driven Prompting (2021.emnlp-main)

Copied to clipboard

Challenge: Task-oriented conversational systems often use dialogue state tracking to represent the user’s intentions, which involves filling in values of pre-defined slots.
Approach: They propose a schema-driven prompting approach that provides task-aware history encoding that is used for both categorical and non-categorical slots.
Outcome: The proposed system achieves state-of-the-art performance on MultiWOZ 2.2 and competitive performance on two other benchmarks: MultiWOz 2.1 and M2M.
NLU++: A Multi-Label, Slot-Rich, Generalisable Dataset for Natural Language Understanding in Task-Oriented Dialogue (2022.findings-naacl)

Copied to clipboard

Challenge: NLU++ provides a more challenging evaluation environment for dialogue NLU models . Typical ToD systems still rely on a modular design .
Approach: They propose to use NLU++ to provide a more challenging evaluation environment for dialogue NLU models.
Outcome: The proposed dataset improves existing datasets and provides a much more challenging evaluation environment for dialogue NLU models.
An Adaptive Prompt Generation Framework for Task-oriented Dialogue System (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing black-box large language models (LLMs) have excellent performance in task-oriented dialogue (TOD) tasks, but obtaining suitable prompts for specific tasks is challenging.
Approach: They propose a black-box large language model that generates domain and slot information in the belief state, which serves as prior knowledge for subsequent prompt generation.
Outcome: The proposed framework outperforms existing prompting methods on the MultiWOZ 2.0 dataset.
End-to-End Task-Oriented Dialogue Systems Based on Schema (2023.findings-acl)

Copied to clipboard

Challenge: Existing approaches for task-oriented dialogue systems rely on a unified schema across domains, but we propose a schema-aware model for task oriented dialogues based on 'slots'
Approach: They propose a schema-aware end-to-end neural network model for handling task-oriented dialogues based on a dynamic set of slots within a unified schema.
Outcome: The proposed model performs better on a well-known dataset than baselines on 'schema-guided dialogue' systems.
A Deep Ensemble Model with Slot Alignment for Sequence-to-Sequence Natural Language Generation (N18-1)

Copied to clipboard

Challenge: a recent study has shown that natural language generators produce utterances with humanlike coherence and naturalness for many different kinds of content.
Approach: They propose to use a neural language generator to generate a syntactically and semantically correct utterance from a given MR.
Outcome: The proposed model outperforms state-of-the-art models on restaurant, TV and laptop datasets.
SGP-TOD: Building Task Bots Effortlessly via Schema-Guided LLM Prompting (2023.findings-emnlp)

Copied to clipboard

Challenge: Experimental results show that SGP-TOD provides state-of-the-art zero-shot performance . prevailing approach for creating task bots is to fine-tune pre-trained language models .
Approach: They propose a Schema-Guided Prompting for building Task-Oriented Dialog systems . they use predefined task schema and dialog policy to instruct fixed LLMs to generate appropriate responses .
Outcome: The proposed system outperforms few-shot approaches on multiwoz, RADDLE, and STAR datasets.
Data-Efficient Paraphrase Generation to Bootstrap Intent Classification and Slot Labeling for New Features in Task-Oriented Dialog Systems (2020.coling-industry)

Copied to clipboard

Challenge: a number of dialog systems have been developed to perform tasks with high accuracy on benchmarks, but there is a problem with annotated seed data.
Approach: They propose a model that augments initial seed data by paraphrasing existing utterances automatically.
Outcome: The proposed approach improves intent classification and slot labeling on a public dataset and with a real-world dialog system.
CoDial: Interpretable Task-Oriented Dialogue Systems Through Dialogue Flow Alignment (2026.acl-long)

Copied to clipboard

Challenge: Recent schema-based TOD frameworks improve generalization by decoupling task logic from language understanding, but their reliance on neural or generative models obscures how task schemas influence behaviour and hence impair interpretability.
Approach: They propose a framework that converts a predefined task schema to a structured heterogeneous graph and then to popular programmatic LLM guardrailing code, such as NVIDIA’s Colang.
Outcome: The proposed framework achieves state-of-the-art performance on the widely used benchmark datasets while providing inherent interpretability in the design.
TOD-Flow: Modeling the Structure of Task-Oriented Dialogues (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in task-oriented dialogue systems have limitations regarding transparency and controllability.
Approach: They propose to infer the TOD-flow graph from dialog data annotated with dialog acts and integrate it with any dialogue model to improve its prediction performance, transparency, and controllability.
Outcome: The proposed approach improves dialog act classification and response generation performance in the MultiWOZ and SGD benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations