Class Lifelong Learning for Intent Detection via Structure Consolidation Networks (2023.findings-acl)
Copied to clipboard
Qingbin Liu, Yanchao Hao, Xiaolong Liu, Bo Li, Dianbo Sui, Shizhu He, Kang Liu, Jun Zhao, Xi Chen, Ningyu Zhang, Jiaoyan Chen
| Challenge: | Existing intent detection models can only handle predefined intent classes in the offline environment. |
| Approach: | They propose a method that continually learns new intent classes from new data . structure-based retrospection and contrastive knowledge distillation are used to solve these problems . |
| Outcome: | The proposed method outperforms existing models on three benchmarks. |
Similar Papers
Prompt Augmented Generative Replay via Supervised Contrastive Learning for Lifelong Intent Detection (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to identify all possible user intents at design time are expensive and require storage of past data. |
| Approach: | They propose to continually train an intent detector on new intents while maintaining performance on prior intents. |
| Outcome: | The proposed method outperforms exemplar replay-based approaches on lifelong intent detection tasks and achieves state-of-the-art on four public datasets. |
Incremental Event Detection via Knowledge Consolidation Networks (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to event detection require a fixed set of pre-defined event types . existing methods cannot handle semantic ambiguity and training data imbalance problems . |
| Approach: | They propose a Knowledge Consolidation Network to address these issues . they propose to use a prototype enhanced retrospection and hierarchical distillation to mitigate the adverse effects of semantic ambiguity and class imbalance. |
| Outcome: | The proposed method outperforms the state-of-the-art model by 19% and 13.4% of whole F1 score on ACE and TAC benchmarks. |
Deep Unknown Intent Detection with Margin Loss (P19-1)
Copied to clipboard
| Challenge: | Existing methods for detecting unknown intents are difficult due to lack of examples. |
| Approach: | They propose a method for detecting unknown intents using bidirectional long-term memory networks with the margin loss as the feature extractor. |
| Outcome: | The proposed method can yield consistent improvements on two benchmark datasets. |
New Intent Discovery with Pre-training and Contrastive Learning (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for identifying intents from unlabeled utterances are label-intensive, inefficient, and inaccurate. |
| Approach: | They propose a multi-task strategy to leverage unlabeled data and external labeled data for representation learning. |
| Outcome: | The proposed method outperforms state-of-the-art methods on three intent recognition benchmarks. |
Incremental Intent Detection for Medical Domain with Contrast Replay Networks (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to detect medical intents require fixed pre-defined intent categories . however, novel medical intent categories incessantly emerge with new data and intents in the real world . |
| Approach: | They propose to incrementally learn emerged medical intents from continually arriving data of new intents while avoiding catastrophically forgetting old ones. |
| Outcome: | The proposed method outperforms the state-of-the-art model on two benchmarks by 5.7% and 9.1% accuracy. |
Continual Few-shot Intent Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Existing intent detection systems are trained with lots of labeled data over a predefined set of intent classes. |
| Approach: | They propose a prefix-guided lightweight encoder with three auxiliary strategies to prevent catastrophic forgetting and negative knowledge transfer across tasks. |
| Outcome: | The proposed system prevents catastrophic forgetting and encourages positive knowledge transfer across tasks. |
CoCoID: Learning Contrastive Representations and Compact Clusters for Semi-Supervised Intent Discovery (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Existing approaches to intent discovery cluster novel intents with prior knowledge from intent-labeled data in a semi-supervised way. |
| Approach: | They propose a semi-supervised intent discovery framework CoCoID with two components . they propose to discriminate user utterance representation learning and intra-cluster knowledge distillation . |
| Outcome: | The proposed framework outperforms state-of-the-art intent discovery models by over 1.4 ACC and ARI points and 1.1 NMI points across four datasets. |
Intent Detection and Discovery from User Logs via Deep Semi-Supervised Contrastive Clustering (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to intent detection rely on epoch wise clustering and classification based on labeled and unlabeled data. |
| Approach: | They propose an end-to-end deep contrastive clustering algorithm that jointly updates model parameters and cluster centers via supervised and self-supervised learning. |
| Outcome: | The proposed approach outperforms baselines on five public datasets and human-in-the-loop variant for practical deployment. |
Joint Slot Filling and Intent Detection via Capsule Neural Networks (P19-1)
Copied to clipboard
| Challenge: | Existing models that label slots and detect intent do not preserve hierarchical relationship between words, slots, and intents. |
| Approach: | They propose a capsule-based neural network model which performs slot filling and intent detection via a dynamic routing-by-agreement schema. |
| Outcome: | The proposed model performs better than existing models and existing models on real-world datasets. |
Zero-shot User Intent Detection via Capsule Neural Networks (D18-1)
Copied to clipboard
| Challenge: | Existing methods to classify intents are labor-intensive and time-consuming as intents will be diverse and new intents may be involved. |
| Approach: | They propose a zero-shot intent detection problem which aims to detect emerging user intents where no labeled utterances are currently available. |
| Outcome: | The proposed model can discriminate emerging intents when no labeled utterances are available in training data. |