SlotRefine: A Fast Non-Autoregressive Model for Joint Intent Detection and Slot Filling (2020.emnlp-main)
Copied to clipboard
| Challenge: | Slot filling and intent detection are two main tasks in spoken language understanding systems. |
| Approach: | They propose a non-autoregressive slot filling model with two-pass iteration mechanism to handle uncoordinated slots problem. |
| Outcome: | The proposed model significantly outperforms previous models in slot filling task while speeding up decoding. |
Similar Papers
GL-GIN: Fast and Accurate Non-Autoregressive Model for Joint Multiple Intent Detection and Slot Filling (2021.acl-long)
Copied to clipboard
| Challenge: | Existing joint models for multi-intent SLU only consider intent detection while ignoring slot filling task. |
| Approach: | They propose a non-autoregressive model for joint multiple intent detection and slot filling . their framework is 11.5 times faster than existing joint models . |
| Outcome: | The proposed model is 11.5 times faster than existing models and is faster than current models. |
MRRL: Modifying the Reference via Reinforcement Learning for Non-Autoregressive Joint Multiple Intent Detection and Slot Filling (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing non-autoregressive models for multiple intent detection and slot filling have limited overall accuracy due to multi-modality problem and lack of alignment between correct predictions. |
| Approach: | They propose a method for multiple intent detection and slot filling that introduces a modifier and employs reinforcement learning to modify the reference. |
| Outcome: | The proposed method outperforms the previous best approach by 3.6 overall accuracy on MixATIS dataset. |
Slot-Gated Modeling for Joint Slot Filling and Intent Prediction (N18-2)
Copied to clipboard
| Challenge: | Existing approaches for slot filling and intent detection have independent attention weights, but they suffer from error propagation due to their independent models. |
| Approach: | They propose a slot gate that focuses on learning the relationship between intent and slot attention vectors to obtain better semantic frame results by the global optimization. |
| Outcome: | The proposed model significantly improves sentence-level semantic frame accuracy with 4.2% and 1.9% relative improvement compared to the attentional model on benchmark ATIS and Snips datasets respectively. |
Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods analyze and compute features collectively for all slot types, and have no way to explain slot filling model decisions. |
| Approach: | They propose a method that learns to generate additional slot type specific features to improve accuracy and provides explanations for slot filling decisions for the first time in a joint NLU model. |
| Outcome: | The proposed model improves on two widely used datasets and provides an explanation for slot filling decisions for the first time. |
Joint Slot Filling and Intent Detection via Capsule Neural Networks (P19-1)
Copied to clipboard
| Challenge: | Existing models that label slots and detect intent do not preserve hierarchical relationship between words, slots, and intents. |
| Approach: | They propose a capsule-based neural network model which performs slot filling and intent detection via a dynamic routing-by-agreement schema. |
| Outcome: | The proposed model performs better than existing models and existing models on real-world datasets. |
Enhancing Joint Multiple Intent Detection and Slot Filling with Global Intent-Slot Co-occurrence (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing joint models only use training procedure to determine the implicit correlation between intents and slots. |
| Approach: | They propose to make full use of the statistical co-occurrence frequency between intents and slots as prior knowledge to enhance joint multiple intent detection and slot filling. |
| Outcome: | The proposed model outperforms state-of-the-art models on two public multi-intent datasets. |
Balanced Joint Adversarial Training for Robust Intent Detection and Slot Filling (2020.coling-main)
Copied to clipboard
| Challenge: | Existing joint models for intent detection and slot filling show insufficient robustness . however, some small changes of inputs can fool the models to produce wrong predictions . |
| Approach: | They propose a joint adversarial training model that generates adversarials to attack the joint model and trains the model to defend against the adversarial examples. |
| Outcome: | The proposed model achieves significantly higher scores and improves robustness on two datasets. |
A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling (P19-1)
Copied to clipboard
| Challenge: | Existing models for slot filling and intent detection lack bi-directional interrelated connections between the intent and slots. |
| Approach: | They propose a bi-directional interrelated model for slot filling and intent detection that uses an SF-ID network to establish direct connections between the two tasks to promote each other mutually. |
| Outcome: | The proposed model improves on ATIS and Snips datasets in sentence-level semantic frame accuracy and improves performance on the two tasks. |
Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent research shows promising results by jointly learning of slot filling and intent detection tasks. |
| Approach: | They propose a way to combine slot filling and slot filler learning to achieve state-of-the-art results. |
| Outcome: | The proposed model outperforms existing methods on benchmark datasets and ATIS datasets. |
A Bi-Model Based RNN Semantic Frame Parsing Model for Intent Detection and Slot Filling (N18-2)
Copied to clipboard
| Challenge: | Intent detection and slot filling are two main tasks for building a spoken language understanding system. |
| Approach: | They propose to use a sequence to sequence model to generate both intent and slot filling tasks together to perform the two tasks jointly. |
| Outcome: | The proposed model achieves 0.5% intent accuracy improvement and 0.9 % slot filling improvement on the ATIS benchmark data. |