Challenge: Existing approaches to detect novel intents have been tested in the last decade.
Approach: They propose a framework to detect multiple novel intents with budgeted human annotation cost.
Outcome: The proposed framework outperforms baseline methods in terms of accuracy and F1-score on a set of benchmark datasets.

Similar Papers

CoCoID: Learning Contrastive Representations and Compact Clusters for Semi-Supervised Intent Discovery (2022.emnlp-industry)

Copied to clipboard

Challenge: Existing approaches to intent discovery cluster novel intents with prior knowledge from intent-labeled data in a semi-supervised way.
Approach: They propose a semi-supervised intent discovery framework CoCoID with two components . they propose to discriminate user utterance representation learning and intra-cluster knowledge distillation .
Outcome: The proposed framework outperforms state-of-the-art intent discovery models by over 1.4 ACC and ARI points and 1.1 NMI points across four datasets.
Intent Detection and Discovery from User Logs via Deep Semi-Supervised Contrastive Clustering (2022.naacl-main)

Copied to clipboard

Challenge: Existing approaches to intent detection rely on epoch wise clustering and classification based on labeled and unlabeled data.
Approach: They propose an end-to-end deep contrastive clustering algorithm that jointly updates model parameters and cluster centers via supervised and self-supervised learning.
Outcome: The proposed approach outperforms baselines on five public datasets and human-in-the-loop variant for practical deployment.
New Intent Discovery with Pre-training and Contrastive Learning (2022.acl-long)

Copied to clipboard

Challenge: Existing methods for identifying intents from unlabeled utterances are label-intensive, inefficient, and inaccurate.
Approach: They propose a multi-task strategy to leverage unlabeled data and external labeled data for representation learning.
Outcome: The proposed method outperforms state-of-the-art methods on three intent recognition benchmarks.
A Pointer Network-based Approach for Joint Extraction and Detection of Multi-Label Multi-Class Intents (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing research focuses on simple queries with a single intent, lacking effective systems for handling complex queries with multiple intents.
Approach: They propose a multi-label multi-class intent detection dataset curated from existing benchmarks and a pointer network-based architecture to extract intent spans and detect multiple intents with coarse and fine-grained labels in the form of sextuplets.
Outcome: The proposed system outperforms baseline approaches in terms of accuracy and F1-score.
LANID: LLM-assisted New Intent Discovery (2024.lrec-main)

Copied to clipboard

Challenge: Data annotation is expensive in Task-Oriented Dialogue systems.
Approach: They propose a framework that leverages Large Language Models' zero-shot capability to enhance the performance of a smaller text encoder on the NID task.
Outcome: The proposed framework surpasses all strong baselines in both unsupervised and semi-supervised settings.
Going beyond research datasets: Novel intent discovery in the industry setting (2023.findings-eacl)

Copied to clipboard

Challenge: Novel intent discovery automates grouping of similar messages to identify previously unknown intents.
Approach: They propose to use question-only data to improve the intent discovery pipeline . they propose to utilize conversational structure of real-life datasets for clustering .
Outcome: The proposed method gives 33pp performance boost over state-of-the-art model for question only . it also gives 13pp performance increase over the naive baseline model .
From Discrimination to Generation: Low-Resource Intent Detection with Language Model Instruction Tuning (2024.findings-acl)

Copied to clipboard

Challenge: Existing studies fine-tune discriminative models on specific defined intent classes, preventing them from being directly adopted to new intent domains.
Approach: They propose to use a pre-trained generative intent model to detect new intents from different domains with no parameter updates.
Outcome: The proposed model outperforms baselines that need further fine-tuning or domain-specific samples.
Towards Real-world Scenario: Imbalanced New Intent Discovery (2024.acl-long)

Copied to clipboard

Challenge: Existing studies focus on detecting known and previously undefined categories of user intent . skewed and long-tailed distributions often encountered in open-world scenarios .
Approach: They propose to use imbalanced new intent discovery task to identify familiar and novel intent categories within long-tailed distributions.
Outcome: The proposed model outperforms the existing benchmark on three datasets to simulate the real-world long-tail distributions.
Prompt Augmented Generative Replay via Supervised Contrastive Learning for Lifelong Intent Detection (2022.findings-naacl)

Copied to clipboard

Challenge: Existing methods to identify all possible user intents at design time are expensive and require storage of past data.
Approach: They propose to continually train an intent detector on new intents while maintaining performance on prior intents.
Outcome: The proposed method outperforms exemplar replay-based approaches on lifelong intent detection tasks and achieves state-of-the-art on four public datasets.
PCMID: Multi-Intent Detection through Supervised Prototypical Contrastive Learning (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to intent detection assume that each utterance represents only a single intent.
Approach: They propose a framework for intent detection that can learn multiple representations of a given user utterance under the context of different intent labels in an optimized semantic space.
Outcome: The proposed framework achieves state-of-the-art on multiple public benchmark datasets and a private real-world dataset for the multi-intent detection task.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations