Few-shot Intent Classification and Slot Filling with Retrieved Examples (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for few-shot learning are based on labeled examples, but they are non-trivial . few-sshot learning is challenging due to the imbalance in the amount of data between the source and target domains. |
| Approach: | They propose retrieval-based methods for intent classification and slot filling tasks . they use a batch-softmax objective to learn similar contextualized representations for spans . |
| Outcome: | The proposed method outperforms previous systems on the CLINC and SNIPS benchmarks. |
Similar Papers
Learning to Bridge Metric Spaces: Few-shot Joint Learning of Intent Detection and Slot Filling (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing few-shot learning methods learn a single task each time with a few examples . but, real-world applications often contain multiple closely related tasks . |
| Approach: | They propose a few-shot joint learning scheme that captures intent and slot relationships from only a handful of examples and adapts the bridged metric space to specific few- shot domain. |
| Outcome: | The proposed model outperforms baseline models on two public datasets on intent and slot . the proposed model significantly outperformed baseline models in one and five shots settings. |
Frustratingly Simple Few-Shot Slot Tagging (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing fewshot methods for slot tagging are weak in encoding slot name semantics and slot dependencies. |
| Approach: | They propose a simple and effective few-shot model for slot tagging which incorporates machine reading comprehension (MRC) using source domain and target domain data. |
| Outcome: | The proposed model outperforms state-of-the-art methods on the SNIPS dataset. |
Making Pre-trained Language Models Better Learn Few-Shot Spoken Language Understanding in More Practical Scenarios (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing few-shot Spoken Language Understanding models need to be trained on a set of data-rich source domains and adapt to the target domain with a few examples. |
| Approach: | They propose a scenario where only a pre-trained language model and a few labeled examples are used to train few-shot SLU models. |
| Outcome: | The proposed model outperforms existing models on few-shot settings by reducing the number of slot labels and reducing training complexity. |
An Explicit-Joint and Supervised-Contrastive Learning Framework for Few-Shot Intent Classification and Slot Filling (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Intent classification and slot filling are key building blocks in task-oriented dialogue systems. |
| Approach: | They propose an explicit-joint and supervised-contrastive learning framework for few-shot intent classification and slot filling. |
| Outcome: | The proposed model extracts intent and slot representations via bidirectional interactions and extends prototypical network to achieve explicit-joint learning. |
Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Network (2020.acl-main)
Copied to clipboard
| Challenge: | Existing few-shot learning methods for slot tagging are based on similarity-based methods, but they are difficult to apply to an unseen domain due to the discrepancy of label sets. |
| Approach: | They propose a label-enhanced task-adaptive projection network to transfer abstract label dependency patterns as transition scores into the conditional random field (CRF) Experimental results show that their model significantly outperforms the strongest few-shot learning baseline by 14.64 F1 scores in the one-shot setting. |
| Outcome: | The proposed model outperforms the strongest few-shot learning baseline by 14.64 F1 scores in the one-shot setting. |
Span-ConveRT: Few-shot Span Extraction for Dialog with Pretrained Conversational Representations (2020.acl-main)
Copied to clipboard
| Challenge: | Span-ConveRT is a light-weight model for dialog slot-filling . we show consistent gains over a span extractor and a BERT-based model . |
| Approach: | They propose a model for dialog slot-filling which frames the task as a turn-based span extraction task. |
| Outcome: | The proposed model is especially useful for few-shot learning scenarios. |
Retrieval-Augmented Few-shot Text Classification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for retrieval-augmented text classification are successful in the few-shot scenario with limited retrieval space. |
| Approach: | They propose to use EM-L and R-L to provide task-specific guidance to retrieval metric . they also propose to incorporate retrieved memory alongside parameters for better generalization . |
| Outcome: | The proposed methods perform better on the few-shot scenario with limited retrieval space. |
Few-shot Learning for Slot Tagging with Attentive Relational Network (2021.eacl-main)
Copied to clipboard
| Challenge: | Recent studies have used metric-based learning in computer vision but not slot tagging. |
| Approach: | They propose a metric-based learning architecture that extends relation networks by leveraging pretrained contextual embeddings such as ELMO and BERT and by using attention mechanism. |
| Outcome: | The proposed method outperforms state-of-the-art methods on SNIPS data on a slot tagging task with a large amount of hand-labeled data. |
A Coarse-to-Fine Prototype Learning Approach for Multi-Label Few-Shot Intent Detection (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for few-shot intent detection are limited due to data scarcity and lack of information for unseen domains. |
| Approach: | They propose to enhance utterance representations with label synset augmentation and refine prototypes by distilling coarse domain knowledge from a universal teacher model. |
| Outcome: | The proposed approach outperforms existing methods in terms of accuracy and generalization across domains. |
Robust Zero-Shot Cross-Domain Slot Filling with Example Values (P19-1)
Copied to clipboard
| Challenge: | Task-oriented dialog systems rely on deep learning-based slot filling models . little to no training data for target domains may be available or schemas may not be aligned . |
| Approach: | They propose to use slot descriptions and examples of slot values to learn slot semantic representations that are transferable across domains and robust to misaligned schemas. |
| Outcome: | The proposed model outperforms state-of-the-art models on two multi-domain datasets on low-data setting. |