Challenge: Existing work on slot filling and intent detection builds joint models without prior knowledge of linguistic knowledge.
Approach: They propose a joint model that integrates syntactic structure for learning slot filling and intent detection jointly.
Outcome: The proposed model outperforms existing models on two public benchmark datasets and further improves on slot filling and intent detection.

Similar Papers

Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks (2021.naacl-main)

Copied to clipboard

Challenge: Recent research shows promising results by jointly learning of slot filling and intent detection tasks.
Approach: They propose a way to combine slot filling and slot filler learning to achieve state-of-the-art results.
Outcome: The proposed model outperforms existing methods on benchmark datasets and ATIS datasets.
Joint Slot Filling and Intent Detection via Capsule Neural Networks (P19-1)

Copied to clipboard

Challenge: Existing models that label slots and detect intent do not preserve hierarchical relationship between words, slots, and intents.
Approach: They propose a capsule-based neural network model which performs slot filling and intent detection via a dynamic routing-by-agreement schema.
Outcome: The proposed model performs better than existing models and existing models on real-world datasets.
A Stack-Propagation Framework with Token-Level Intent Detection for Spoken Language Understanding (D19-1)

Copied to clipboard

Challenge: Intent detection and slot filling are two main tasks for building a spoken language understanding system.
Approach: They propose a framework to incorporate intent information into slot filling tasks . they use a joint model with Stack-Propagation to capture intent semantic knowledge .
Outcome: The proposed model outperforms existing models on two publicly available datasets and outperformed existing models by a large margin.
Enhancing Joint Multiple Intent Detection and Slot Filling with Global Intent-Slot Co-occurrence (2022.emnlp-main)

Copied to clipboard

Challenge: Existing joint models only use training procedure to determine the implicit correlation between intents and slots.
Approach: They propose to make full use of the statistical co-occurrence frequency between intents and slots as prior knowledge to enhance joint multiple intent detection and slot filling.
Outcome: The proposed model outperforms state-of-the-art models on two public multi-intent datasets.
AGIF: An Adaptive Graph-Interactive Framework for Joint Multiple Intent Detection and Slot Filling (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing models focus on the single intent scenario, ignoring the fine-grained multiple intents information integration for token-level slot prediction.
Approach: They propose an Adaptive Graph-Interactive Framework for joint multiple intent detection and slot filling . they propose an intent-slot graph interaction layer to model the strong correlation between the slot and intents .
Outcome: The proposed framework improves on three multi-intent datasets and new state-of-the-art performance on single-intention datasets.
A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling (P19-1)

Copied to clipboard

Challenge: Existing models for slot filling and intent detection lack bi-directional interrelated connections between the intent and slots.
Approach: They propose a bi-directional interrelated model for slot filling and intent detection that uses an SF-ID network to establish direct connections between the two tasks to promote each other mutually.
Outcome: The proposed model improves on ATIS and Snips datasets in sentence-level semantic frame accuracy and improves performance on the two tasks.
Improving Slot Filling in Spoken Language Understanding with Joint Pointer and Attention (P18-2)

Copied to clipboard

Challenge: Experimental results show the effectiveness of our slot filling model at addressing the OOV problem.
Approach: They propose a generative neural network model for slot filling based on a sequence-to-sequence model and a pointer network.
Outcome: The proposed model is able to predict slot values on spoken language data.
Slot-Gated Modeling for Joint Slot Filling and Intent Prediction (N18-2)

Copied to clipboard

Challenge: Existing approaches for slot filling and intent detection have independent attention weights, but they suffer from error propagation due to their independent models.
Approach: They propose a slot gate that focuses on learning the relationship between intent and slot attention vectors to obtain better semantic frame results by the global optimization.
Outcome: The proposed model significantly improves sentence-level semantic frame accuracy with 4.2% and 1.9% relative improvement compared to the attentional model on benchmark ATIS and Snips datasets respectively.
A Bi-Model Based RNN Semantic Frame Parsing Model for Intent Detection and Slot Filling (N18-2)

Copied to clipboard

Challenge: Intent detection and slot filling are two main tasks for building a spoken language understanding system.
Approach: They propose to use a sequence to sequence model to generate both intent and slot filling tasks together to perform the two tasks jointly.
Outcome: The proposed model achieves 0.5% intent accuracy improvement and 0.9 % slot filling improvement on the ATIS benchmark data.
Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods analyze and compute features collectively for all slot types, and have no way to explain slot filling model decisions.
Approach: They propose a method that learns to generate additional slot type specific features to improve accuracy and provides explanations for slot filling decisions for the first time in a joint NLU model.
Outcome: The proposed model improves on two widely used datasets and provides an explanation for slot filling decisions for the first time.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations