Challenge: Existing studies struggle to achieve performance comparable to that on high-resource languages due to inherent linguistic diversity of multilingual SLU tasks.
Approach: They propose a multilingual information transfer network to solve these challenges . they propose to reformulate SF as a span prediction problem and introduce a slot-matching attention mechanism to achieve slot alignment across languages.
Outcome: The proposed model outperforms baseline models on the MASSIVE and MASSIV-UG datasets in overall accuracy across all languages.

Similar Papers

A Stack-Propagation Framework with Token-Level Intent Detection for Spoken Language Understanding (D19-1)

Copied to clipboard

Challenge: Intent detection and slot filling are two main tasks for building a spoken language understanding system.
Approach: They propose a framework to incorporate intent information into slot filling tasks . they use a joint model with Stack-Propagation to capture intent semantic knowledge .
Outcome: The proposed model outperforms existing models on two publicly available datasets and outperformed existing models by a large margin.
A Novel Bi-directional Interrelated Model for Joint Intent Detection and Slot Filling (P19-1)

Copied to clipboard

Challenge: Existing models for slot filling and intent detection lack bi-directional interrelated connections between the intent and slots.
Approach: They propose a bi-directional interrelated model for slot filling and intent detection that uses an SF-ID network to establish direct connections between the two tasks to promote each other mutually.
Outcome: The proposed model improves on ATIS and Snips datasets in sentence-level semantic frame accuracy and improves performance on the two tasks.
STIL - Simultaneous Slot Filling, Translation, Intent Classification, and Language Identification: Initial Results using mBART on MultiATIS++ (2020.aacl-main)

Copied to clipboard

Challenge: Slot-filling, Translation, Intent classification, and Language identification (STIL) are tasks for multilingual Natural Language Understanding (NLU) .
Approach: They propose to perform simultaneous slot filling and translation into a single output language (English in this case).
Outcome: The proposed task performs better than the current state-of-the-art system for the languages tested, but with lower intent classification accuracy and lower slot F1 .
Explainable Slot Type Attentions to Improve Joint Intent Detection and Slot Filling (2022.findings-emnlp)

Copied to clipboard

Challenge: Existing methods analyze and compute features collectively for all slot types, and have no way to explain slot filling model decisions.
Approach: They propose a method that learns to generate additional slot type specific features to improve accuracy and provides explanations for slot filling decisions for the first time in a joint NLU model.
Outcome: The proposed model improves on two widely used datasets and provides an explanation for slot filling decisions for the first time.
A Bi-Model Based RNN Semantic Frame Parsing Model for Intent Detection and Slot Filling (N18-2)

Copied to clipboard

Challenge: Intent detection and slot filling are two main tasks for building a spoken language understanding system.
Approach: They propose to use a sequence to sequence model to generate both intent and slot filling tasks together to perform the two tasks jointly.
Outcome: The proposed model achieves 0.5% intent accuracy improvement and 0.9 % slot filling improvement on the ATIS benchmark data.
Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks (2021.naacl-main)

Copied to clipboard

Challenge: Recent research shows promising results by jointly learning of slot filling and intent detection tasks.
Approach: They propose a way to combine slot filling and slot filler learning to achieve state-of-the-art results.
Outcome: The proposed model outperforms existing methods on benchmark datasets and ATIS datasets.
From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding (2021.naacl-main)

Copied to clipboard

Challenge: Lack of publicly available evaluation data for low-resource languages limits progress in SLU . despite advances in neural modeling for slot and intent detection, datasets for SLU remain limited.
Approach: They propose a joint learning approach with English SLU training data and non-English auxiliary tasks from raw text, syntax and translation for transfer.
Outcome: The proposed model can learn English SLU training data and non-English auxiliary tasks from raw text, syntax and translation for transfer.
INJONGO: A Multicultural Intent Detection and Slot-filling Dataset for 16 African Languages (2025.acl-long)

Copied to clipboard

Challenge: Slot-filling and intent detection tasks are well-established tasks in Conversational AI, but current benchmarks for these tasks rely on evaluations of low-resource languages and translations from English benchmarks.
Approach: They propose to use a multilingual, open-source benchmark dataset for 16 African languages with utterances generated by native speakers across diverse domains.
Outcome: The proposed dataset compares multilingual transformer models and prompting large language models (LLMs) with the English language.
Joint Slot Filling and Intent Detection via Capsule Neural Networks (P19-1)

Copied to clipboard

Challenge: Existing models that label slots and detect intent do not preserve hierarchical relationship between words, slots, and intents.
Approach: They propose a capsule-based neural network model which performs slot filling and intent detection via a dynamic routing-by-agreement schema.
Outcome: The proposed model performs better than existing models and existing models on real-world datasets.
End-to-End Slot Alignment and Recognition for Cross-Lingual NLU (2020.emnlp-main)

Copied to clipboard

Challenge: Existing methods to expand an NLU system to new languages use machine translation with slot label projection from source to translated utterances.
Approach: They propose a novel end-to-end model that learns to align and predict target slot labels jointly for cross-lingual transfer.
Outcome: The proposed model outperforms a simple label projection method on most languages and achieves competitive performance to the more complex, state-of-the-art projection method with only half the training time.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations