PICD-Instruct: A Generative Instruction Learning Framework for Few-Shot Multi-Intent Spoken Language Understanding (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have utilized instruction learning frameworks to model intent-slot interdependencies, typically requiring abundant data for effective training. |
| Approach: | They propose a generative framework based on Basic Instructions (BI), Pairwise Interaction Instructions and Contrastive Distinct Instructions to solve these challenges. |
| Outcome: | The proposed framework achieves state-of-the-art performance on public datasets. |
Similar Papers
DC-Instruct: An Effective Framework for Generative Multi-intent Spoken Language Understanding (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing prompt learning frameworks lack explicit modeling of dual-task dependencies and oversight of task-specific semantic differences among utterances. |
| Approach: | They propose a generative framework based on Dual-task Inter-dependent Instructions (DII) and Supervised Contrastive Instructions that leverages utterance semantics differences by guiding LLMs to determine whether a pair of utterrances share the same or similar labels. |
| Outcome: | The proposed framework outperforms existing models and state-of-the-art methods on public benchmark datasets and shows that it improves SLU reasoning. |
An Explicit-Joint and Supervised-Contrastive Learning Framework for Few-Shot Intent Classification and Slot Filling (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Intent classification and slot filling are key building blocks in task-oriented dialogue systems. |
| Approach: | They propose an explicit-joint and supervised-contrastive learning framework for few-shot intent classification and slot filling. |
| Outcome: | The proposed model extracts intent and slot representations via bidirectional interactions and extends prototypical network to achieve explicit-joint learning. |
Making Pre-trained Language Models Better Learn Few-Shot Spoken Language Understanding in More Practical Scenarios (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing few-shot Spoken Language Understanding models need to be trained on a set of data-rich source domains and adapt to the target domain with a few examples. |
| Approach: | They propose a scenario where only a pre-trained language model and a few labeled examples are used to train few-shot SLU models. |
| Outcome: | The proposed model outperforms existing models on few-shot settings by reducing the number of slot labels and reducing training complexity. |
Learning to Bridge Metric Spaces: Few-shot Joint Learning of Intent Detection and Slot Filling (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing few-shot learning methods learn a single task each time with a few examples . but, real-world applications often contain multiple closely related tasks . |
| Approach: | They propose a few-shot joint learning scheme that captures intent and slot relationships from only a handful of examples and adapts the bridged metric space to specific few- shot domain. |
| Outcome: | The proposed model outperforms baseline models on two public datasets on intent and slot . the proposed model significantly outperformed baseline models in one and five shots settings. |
Incorporating Instructional Prompts into a Unified Generative Framework for Joint Multiple Intent Detection and Slot Filling (2022.coling-1)
Copied to clipboard
| Challenge: | Existing approaches to multiple intent detection and slot filling focus on task-specific components to capture the relationships between intents and slots. |
| Approach: | They propose a Unified Generative framework that captures the relationships between intents and slots in an utterance and formulates the task as a question-answering problem. |
| Outcome: | The proposed framework surpasses baselines on full-data and multi-intent benchmarks on 5-shot and 10-shot scenarios. |
ILLUMINER: Instruction-tuned Large Language Models as Few-shot Intent Classifier and Slot Filler (2024.lrec-main)
Copied to clipboard
| Challenge: | State-of-the-art intent classification and slot filling methods rely on data-intensive deep learning models . large language models exhibit remarkable zero-shot performance across various natural language tasks. |
| Approach: | They propose an approach framing IC and SF as language generation tasks for instruction-LLMs with a more efficient SF-prompting method. |
| Outcome: | The proposed approach outperforms state-of-the-art IC+SF method and in-context learning methods with GPT3.5 (175B). |
The Devil is in the Details: On Models and Training Regimes for Few-Shot Intent Classification (2023.eacl-main)
Copied to clipboard
| Challenge: | Recent methods for task-oriented dialog (ToD) intent classification use pretrained language models . but lack of informative ablations prevents identification of factors that drive performance . |
| Approach: | They propose a framework to evaluate components of Few-Shot Intent Classification . they propose to combine cross-encoder architecture and episodic meta-learning . |
| Outcome: | The proposed framework evaluates cross-encoder architecture and episodic meta-learning . it also shows that splitting episodes into support and query sets outperforms non-episodic counterparts. |
IntenDD: A Unified Contrastive Learning Approach for Intent Detection and Discovery (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Intent-related tasks are typically modeled as separate tasks, but a unified approach is proposed . INTENDD uses an entirely unsupervised contrastive learning strategy for representation learning . |
| Approach: | They propose a unified approach to identifying intents from dialogue utterances . they propose an unsupervised contrastive learning strategy for representation learning . |
| Outcome: | The proposed approach outperforms baselines on three intent-related tasks on multiple datasets. |
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning (2021.emnlp-main)
Copied to clipboard
Jianguo Zhang, Trung Bui, Seunghyun Yoon, Xiang Chen, Zhiwei Liu, Congying Xia, Quan Hung Tran, Walter Chang, Philip Yu
| Challenge: | Existing methods address few-shot intent detection tasks from two perspectives: data augmentation and task-adaptive training with pre-trained models. |
| Approach: | They propose a few-shot intent detection schema using contrastive pre-training and fine-tuning. |
| Outcome: | The proposed method achieves state-of-the-art performance on three challenging intent detection datasets under 5-shot and 10-shot settings. |
Few-shot Intent Classification and Slot Filling with Retrieved Examples (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for few-shot learning are based on labeled examples, but they are non-trivial . few-sshot learning is challenging due to the imbalance in the amount of data between the source and target domains. |
| Approach: | They propose retrieval-based methods for intent classification and slot filling tasks . they use a batch-softmax objective to learn similar contextualized representations for spans . |
| Outcome: | The proposed method outperforms previous systems on the CLINC and SNIPS benchmarks. |