A Self-Attentive Model with Gate Mechanism for Spoken Language Understanding (D18-1)
Copied to clipboard
| Challenge: | Spoken language understanding (SLU) involves intent determination and slot filling . existing joint learning methods only consider joint learning by sharing parameters on surface level rather than semantic level. |
| Approach: | They propose a self-attentive model to fully utilize the semantic correlation between slot and intent. |
| Outcome: | The proposed model outperforms existing methods in both intent detection and slot filling tasks on ATIS benchmarks. |
Similar Papers
Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent research shows promising results by jointly learning of slot filling and intent detection tasks. |
| Approach: | They propose a way to combine slot filling and slot filler learning to achieve state-of-the-art results. |
| Outcome: | The proposed model outperforms existing methods on benchmark datasets and ATIS datasets. |
A Stack-Propagation Framework with Token-Level Intent Detection for Spoken Language Understanding (D19-1)
Copied to clipboard
| Challenge: | Intent detection and slot filling are two main tasks for building a spoken language understanding system. |
| Approach: | They propose a framework to incorporate intent information into slot filling tasks . they use a joint model with Stack-Propagation to capture intent semantic knowledge . |
| Outcome: | The proposed model outperforms existing models on two publicly available datasets and outperformed existing models by a large margin. |
A Bi-Model Based RNN Semantic Frame Parsing Model for Intent Detection and Slot Filling (N18-2)
Copied to clipboard
| Challenge: | Intent detection and slot filling are two main tasks for building a spoken language understanding system. |
| Approach: | They propose to use a sequence to sequence model to generate both intent and slot filling tasks together to perform the two tasks jointly. |
| Outcome: | The proposed model achieves 0.5% intent accuracy improvement and 0.9 % slot filling improvement on the ATIS benchmark data. |
A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling (P19-1)
Copied to clipboard
| Challenge: | Existing models for slot filling and intent detection lack bi-directional interrelated connections between the intent and slots. |
| Approach: | They propose a bi-directional interrelated model for slot filling and intent detection that uses an SF-ID network to establish direct connections between the two tasks to promote each other mutually. |
| Outcome: | The proposed model improves on ATIS and Snips datasets in sentence-level semantic frame accuracy and improves performance on the two tasks. |
Slot-Gated Modeling for Joint Slot Filling and Intent Prediction (N18-2)
Copied to clipboard
| Challenge: | Existing approaches for slot filling and intent detection have independent attention weights, but they suffer from error propagation due to their independent models. |
| Approach: | They propose a slot gate that focuses on learning the relationship between intent and slot attention vectors to obtain better semantic frame results by the global optimization. |
| Outcome: | The proposed model significantly improves sentence-level semantic frame accuracy with 4.2% and 1.9% relative improvement compared to the attentional model on benchmark ATIS and Snips datasets respectively. |
Improving Slot Filling in Spoken Language Understanding with Joint Pointer and Attention (P18-2)
Copied to clipboard
| Challenge: | Experimental results show the effectiveness of our slot filling model at addressing the OOV problem. |
| Approach: | They propose a generative neural network model for slot filling based on a sequence-to-sequence model and a pointer network. |
| Outcome: | The proposed model is able to predict slot values on spoken language data. |
Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods analyze and compute features collectively for all slot types, and have no way to explain slot filling model decisions. |
| Approach: | They propose a method that learns to generate additional slot type specific features to improve accuracy and provides explanations for slot filling decisions for the first time in a joint NLU model. |
| Outcome: | The proposed model improves on two widely used datasets and provides an explanation for slot filling decisions for the first time. |
New Semantic Task for the French Spoken Language Understanding MEDIA Benchmark (2024.lrec-main)
Copied to clipboard
| Challenge: | Intent classification and slot-filling tasks are essential tasks of Spoken Language Understanding (SLU). |
| Approach: | They propose to use a MEDIA SLU dataset to train a multilingual model to achieve both tasks jointly. |
| Outcome: | The proposed model can be trained on multiple datasets including the MEDIA dataset and extends to more tasks and use cases. |
Joint Slot Filling and Intent Detection via Capsule Neural Networks (P19-1)
Copied to clipboard
| Challenge: | Existing models that label slots and detect intent do not preserve hierarchical relationship between words, slots, and intents. |
| Approach: | They propose a capsule-based neural network model which performs slot filling and intent detection via a dynamic routing-by-agreement schema. |
| Outcome: | The proposed model performs better than existing models and existing models on real-world datasets. |
CM-Net: A Novel Collaborative Memory Network for Spoken Language Understanding (D19-1)
Copied to clipboard
| Challenge: | Existing models for slot filling and intent detection fail to fully utilize cooccurrence relations between slots and intents, which restricts their potential performance. |
| Approach: | They propose a novel Collaborative Memory Network (CM-Net) that captures slot-specific and intent-specific features in a collaborative manner. |
| Outcome: | The proposed network outperforms existing models on two benchmarks and a self-collected corpus. |