| Challenge: | Existing methods for identifying intents from unlabeled utterances are label-intensive, inefficient, and inaccurate. |
| Approach: | They propose a multi-task strategy to leverage unlabeled data and external labeled data for representation learning. |
| Outcome: | The proposed method outperforms state-of-the-art methods on three intent recognition benchmarks. |
Similar Papers
IntenDD: A Unified Contrastive Learning Approach for Intent Detection and Discovery (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Intent-related tasks are typically modeled as separate tasks, but a unified approach is proposed . INTENDD uses an entirely unsupervised contrastive learning strategy for representation learning . |
| Approach: | They propose a unified approach to identifying intents from dialogue utterances . they propose an unsupervised contrastive learning strategy for representation learning . |
| Outcome: | The proposed approach outperforms baselines on three intent-related tasks on multiple datasets. |
Intent Detection and Discovery from User Logs via Deep Semi-Supervised Contrastive Clustering (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to intent detection rely on epoch wise clustering and classification based on labeled and unlabeled data. |
| Approach: | They propose an end-to-end deep contrastive clustering algorithm that jointly updates model parameters and cluster centers via supervised and self-supervised learning. |
| Outcome: | The proposed approach outperforms baselines on five public datasets and human-in-the-loop variant for practical deployment. |
CoCoID: Learning Contrastive Representations and Compact Clusters for Semi-Supervised Intent Discovery (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Existing approaches to intent discovery cluster novel intents with prior knowledge from intent-labeled data in a semi-supervised way. |
| Approach: | They propose a semi-supervised intent discovery framework CoCoID with two components . they propose to discriminate user utterance representation learning and intra-cluster knowledge distillation . |
| Outcome: | The proposed framework outperforms state-of-the-art intent discovery models by over 1.4 ACC and ARI points and 1.1 NMI points across four datasets. |
Pseudo-Label Enhanced Prototypical Contrastive Learning for Uniformed Intent Discovery (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods focus on transferring in-domain (IND) prior knowledge to out-of-domain data through pre-training and clustering. |
| Approach: | They propose a Pseudo-Label enhanced Prototypical Contrastive Learning model for uniformed intent discovery that integrates supervised and pseudo signals from IND and OOD data. |
| Outcome: | The proposed method has been proven effective in two different settings of discovering new intents. |
ClusterPrompt: Cluster Semantic Enhanced Prompt Learning for New Intent Discovery (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for identifying new intent categories focus on relations between utterances and clusters, while neglecting the usage of semantics. |
| Approach: | They propose a method that leverages contrastive learning and label semantic alignment to learn meaningful representations of intent clusters. |
| Outcome: | The proposed method outperforms existing methods and suggests meaningful intent labels. |
Intent Discovery for Enterprise Virtual Assistants: Applications of Utterance Embedding and Clustering to Intent Mining (2022.naacl-industry)
Copied to clipboard
| Challenge: | Existing approaches to clustering unlabeled utterances are based on transformerbased sentence embedding methods. |
| Approach: | They propose a semantic embedding approach that can be leveraged to identify clusters of utterances that correspond to unhandled intents. |
| Outcome: | The proposed approach can identify clusters of utterances that correspond to unhandled intents from a large collection of enterprise virtual assistant data using a multi-task softmax loss. |
New Intent Discovery with Attracting and Dispersing Prototype (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for detecting new intents with labeled data are not cluster-friendly . a robust prototypical attracting learning (RPAL) method is designed to compel instances to gravitate toward their corresponding prototype . |
| Approach: | They propose a robust and adaptive prototypical learning framework for globally distinct decision boundaries for both known and new intent categories. |
| Outcome: | The proposed method improves on CLINC, BANKING, and StackOverflow benchmarks on three challenging benchmarks. |
Going beyond research datasets: Novel intent discovery in the industry setting (2023.findings-eacl)
Copied to clipboard
| Challenge: | Novel intent discovery automates grouping of similar messages to identify previously unknown intents. |
| Approach: | They propose to use question-only data to improve the intent discovery pipeline . they propose to utilize conversational structure of real-life datasets for clustering . |
| Outcome: | The proposed method gives 33pp performance boost over state-of-the-art model for question only . it also gives 13pp performance increase over the naive baseline model . |
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning (2021.emnlp-main)
Copied to clipboard
Jianguo Zhang, Trung Bui, Seunghyun Yoon, Xiang Chen, Zhiwei Liu, Congying Xia, Quan Hung Tran, Walter Chang, Philip Yu
| Challenge: | Existing methods address few-shot intent detection tasks from two perspectives: data augmentation and task-adaptive training with pre-trained models. |
| Approach: | They propose a few-shot intent detection schema using contrastive pre-training and fine-tuning. |
| Outcome: | The proposed method achieves state-of-the-art performance on three challenging intent detection datasets under 5-shot and 10-shot settings. |
Decoupling Pseudo Label Disambiguation and Representation Learning for Generalized Intent Discovery (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for generalized intent discovery lack pseudo label disambiguation and representation learning. |
| Approach: | They propose a prototype learning framework to decouple pseudo label disambiguation and representation learning. |
| Outcome: | The proposed method can decouple pseudo label disambiguation and representation learning. |