Enhancing Joint Multiple Intent Detection and Slot Filling with Global Intent-Slot Co-occurrence (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing joint models only use training procedure to determine the implicit correlation between intents and slots. |
| Approach: | They propose to make full use of the statistical co-occurrence frequency between intents and slots as prior knowledge to enhance joint multiple intent detection and slot filling. |
| Outcome: | The proposed model outperforms state-of-the-art models on two public multi-intent datasets. |
Similar Papers
Slot-Gated Modeling for Joint Slot Filling and Intent Prediction (N18-2)
Copied to clipboard
| Challenge: | Existing approaches for slot filling and intent detection have independent attention weights, but they suffer from error propagation due to their independent models. |
| Approach: | They propose a slot gate that focuses on learning the relationship between intent and slot attention vectors to obtain better semantic frame results by the global optimization. |
| Outcome: | The proposed model significantly improves sentence-level semantic frame accuracy with 4.2% and 1.9% relative improvement compared to the attentional model on benchmark ATIS and Snips datasets respectively. |
Joint Slot Filling and Intent Detection via Capsule Neural Networks (P19-1)
Copied to clipboard
| Challenge: | Existing models that label slots and detect intent do not preserve hierarchical relationship between words, slots, and intents. |
| Approach: | They propose a capsule-based neural network model which performs slot filling and intent detection via a dynamic routing-by-agreement schema. |
| Outcome: | The proposed model performs better than existing models and existing models on real-world datasets. |
GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Filling (2021.acl-long)
Copied to clipboard
| Challenge: | Existing joint models for multi-intent SLU only consider intent detection while ignoring slot filling task. |
| Approach: | They propose a non-autoregressive model for joint multiple intent detection and slot filling . their framework is 11.5 times faster than existing joint models . |
| Outcome: | The proposed model is 11.5 times faster than existing models and is faster than current models. |
MISCA: A Joint Model for Multiple Intent Detection and Slot Filling with Intent-Slot Co-Attention (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models for detecting multiple intents and filling slots are based on graphs but face problems . a joint model can exploit the correlations between intents, slots and slot filling tasks . |
| Approach: | They propose a joint model that captures correlations between intents and slot labels . they propose MISCA to incorporate an intent-slot co-attention mechanism and a label attention mechanism . |
| Outcome: | The proposed model outperforms previous models on two benchmark datasets. |
Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods analyze and compute features collectively for all slot types, and have no way to explain slot filling model decisions. |
| Approach: | They propose a method that learns to generate additional slot type specific features to improve accuracy and provides explanations for slot filling decisions for the first time in a joint NLU model. |
| Outcome: | The proposed model improves on two widely used datasets and provides an explanation for slot filling decisions for the first time. |
Group is better than individual: Exploiting Label Topologies and Label Relations for Joint Multiple Intent Detection and Slot Filling (2022.emnlp-main)
Copied to clipboard
| Challenge: | Recent joint multiple intent detection and slot filling models ignore the dependencies among labels and label embeddings. |
| Approach: | They propose to construct a Heterogeneous Label Graph (HLG) containing two kinds of topologies and a novel model termed ReLa-Net which captures beneficial correlations among the labels from HLG. |
| Outcome: | The proposed model outperforms the previous model by over 20% on MixATIS dataset. |
A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling (P19-1)
Copied to clipboard
| Challenge: | Existing models for slot filling and intent detection lack bi-directional interrelated connections between the intent and slots. |
| Approach: | They propose a bi-directional interrelated model for slot filling and intent detection that uses an SF-ID network to establish direct connections between the two tasks to promote each other mutually. |
| Outcome: | The proposed model improves on ATIS and Snips datasets in sentence-level semantic frame accuracy and improves performance on the two tasks. |
AGIF: An Adaptive Graph-Interactive Framework for Joint Multiple Intent Detection and Slot Filling (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models focus on the single intent scenario, ignoring the fine-grained multiple intents information integration for token-level slot prediction. |
| Approach: | They propose an Adaptive Graph-Interactive Framework for joint multiple intent detection and slot filling . they propose an intent-slot graph interaction layer to model the strong correlation between the slot and intents . |
| Outcome: | The proposed framework improves on three multi-intent datasets and new state-of-the-art performance on single-intention datasets. |
An Explicit-Joint and Supervised-Contrastive Learning Framework for Few-Shot Intent Classification and Slot Filling (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Intent classification and slot filling are key building blocks in task-oriented dialogue systems. |
| Approach: | They propose an explicit-joint and supervised-contrastive learning framework for few-shot intent classification and slot filling. |
| Outcome: | The proposed model extracts intent and slot representations via bidirectional interactions and extends prototypical network to achieve explicit-joint learning. |
Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent research shows promising results by jointly learning of slot filling and intent detection tasks. |
| Approach: | They propose a way to combine slot filling and slot filler learning to achieve state-of-the-art results. |
| Outcome: | The proposed model outperforms existing methods on benchmark datasets and ATIS datasets. |