Challenge: Intent detection and slot filling are two main tasks for building a spoken language understanding system.
Approach: They propose to use a sequence to sequence model to generate both intent and slot filling tasks together to perform the two tasks jointly.
Outcome: The proposed model achieves 0.5% intent accuracy improvement and 0.9 % slot filling improvement on the ATIS benchmark data.

Similar Papers

Joint Slot Filling and Intent Detection via Capsule Neural Networks (P19-1)

Copied to clipboard

Challenge: Existing models that label slots and detect intent do not preserve hierarchical relationship between words, slots, and intents.
Approach: They propose a capsule-based neural network model which performs slot filling and intent detection via a dynamic routing-by-agreement schema.
Outcome: The proposed model performs better than existing models and existing models on real-world datasets.
Slot-Gated Modeling for Joint Slot Filling and Intent Prediction (N18-2)

Copied to clipboard

Challenge: Existing approaches for slot filling and intent detection have independent attention weights, but they suffer from error propagation due to their independent models.
Approach: They propose a slot gate that focuses on learning the relationship between intent and slot attention vectors to obtain better semantic frame results by the global optimization.
Outcome: The proposed model significantly improves sentence-level semantic frame accuracy with 4.2% and 1.9% relative improvement compared to the attentional model on benchmark ATIS and Snips datasets respectively.
A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling (P19-1)

Copied to clipboard

Challenge: Existing models for slot filling and intent detection lack bi-directional interrelated connections between the intent and slots.
Approach: They propose a bi-directional interrelated model for slot filling and intent detection that uses an SF-ID network to establish direct connections between the two tasks to promote each other mutually.
Outcome: The proposed model improves on ATIS and Snips datasets in sentence-level semantic frame accuracy and improves performance on the two tasks.
A Stack-Propagation Framework with Token-Level Intent Detection for Spoken Language Understanding (D19-1)

Copied to clipboard

Challenge: Intent detection and slot filling are two main tasks for building a spoken language understanding system.
Approach: They propose a framework to incorporate intent information into slot filling tasks . they use a joint model with Stack-Propagation to capture intent semantic knowledge .
Outcome: The proposed model outperforms existing models on two publicly available datasets and outperformed existing models by a large margin.
Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks (2021.naacl-main)

Copied to clipboard

Challenge: Recent research shows promising results by jointly learning of slot filling and intent detection tasks.
Approach: They propose a way to combine slot filling and slot filler learning to achieve state-of-the-art results.
Outcome: The proposed model outperforms existing methods on benchmark datasets and ATIS datasets.
LCAN: A Label-Aware Contrastive Attention Network for Multi-Intent Recognition and Slot Filling in Task-Oriented Dialogue Systems (2025.findings-emnlp)

Copied to clipboard

Challenge: Multi-intent utterances processing remains a persistent challenge due to intricate intent-slot dependencies and semantic ambiguities.
Approach: They propose a label-aware contrastive attention network (LCAN) that integrates label-based attention and contrastive learning strategies to improve semantic understanding and generalization in multi-intent scenarios.
Outcome: The proposed model improves intent recognition and slot filling performance in multi-intent dialogue systems.
Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods analyze and compute features collectively for all slot types, and have no way to explain slot filling model decisions.
Approach: They propose a method that learns to generate additional slot type specific features to improve accuracy and provides explanations for slot filling decisions for the first time in a joint NLU model.
Outcome: The proposed model improves on two widely used datasets and provides an explanation for slot filling decisions for the first time.
INT: Establishing Information Transfer for Multilingual Intent Detection and Slot Filling (2025.findings-acl)

Copied to clipboard

Challenge: Existing studies struggle to achieve performance comparable to that on high-resource languages due to inherent linguistic diversity of multilingual SLU tasks.
Approach: They propose a multilingual information transfer network to solve these challenges . they propose to reformulate SF as a span prediction problem and introduce a slot-matching attention mechanism to achieve slot alignment across languages.
Outcome: The proposed model outperforms baseline models on the MASSIVE and MASSIV-UG datasets in overall accuracy across all languages.
SPM: A Split-Parsing Method for Joint Multi-Intent Detection and Slot Filling (2023.acl-industry)

Copied to clipboard

Challenge: Existing studies focus on utterances with a single intent, but lack the ability to assign slots to each corresponding intent.
Approach: They propose a split-parsing method for joint intent detection and slot filling . they split an input sentence into multiple sub-sentences which contain a single-intent .
Outcome: The proposed method improves on three multi-intent datasets on multi-tasks.
A Self-Attentive Model with Gate Mechanism for Spoken Language Understanding (D18-1)

Copied to clipboard

Challenge: Spoken language understanding (SLU) involves intent determination and slot filling . existing joint learning methods only consider joint learning by sharing parameters on surface level rather than semantic level.
Approach: They propose a self-attentive model to fully utilize the semantic correlation between slot and intent.
Outcome: The proposed model outperforms existing methods in both intent detection and slot filling tasks on ATIS benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations