| Challenge: | Existing dialog datasets rely on human labeling, which is expensive, limited in size, and in low coverage. |
| Approach: | They propose a framework to automatically cluster dialogue intents and slots . they collect context features, leverage an autoencoder for feature assembly, and adapt a dynamic hierarchical clustering method for intent and slot labeling. |
| Outcome: | The proposed framework can promote human labeling cost to a great extent and achieve good intent clustering accuracy (84.1%) it also provides reasonable and instructive slot labeling results. |
Similar Papers
Data-Efficient Paraphrase Generation to Bootstrap Intent Classification and Slot Labeling for New Features in Task-Oriented Dialog Systems (2020.coling-industry)
Copied to clipboard
| Challenge: | a number of dialog systems have been developed to perform tasks with high accuracy on benchmarks, but there is a problem with annotated seed data. |
| Approach: | They propose a model that augments initial seed data by paraphrasing existing utterances automatically. |
| Outcome: | The proposed approach improves intent classification and slot labeling on a public dataset and with a real-world dialog system. |
Discovering Dialogue Slots with Weak Supervision (2021.acl-long)
Copied to clipboard
| Challenge: | Task-oriented dialogue systems typically require manual annotation of dialogue slots in training data. |
| Approach: | They propose a method that uses weak supervision to identify slot candidates and automatically identify domain-relevant slots by using clustering algorithms. |
| Outcome: | The proposed method significantly improves an end-to-end dialogue response generation model compared to using no slot annotation at all. |
Unsupervised Slot Schema Induction for Task-oriented Dialog (2022.naacl-main)
Copied to clipboard
| Challenge: | Defining task-specific schemas is the first step of building a task-oriented dialog system. |
| Approach: | They propose an unsupervised approach for slot schema induction from unlabeled dialog corpora using in-domain language models and unsupervised parsing structures. |
| Outcome: | The proposed method shows significant performance improvement on multi-domain and SGD datasets. |
Dialogue Act Classification with Context-Aware Self-Attention (N19-1)
Copied to clipboard
| Challenge: | Recent work in Dialogue Act classification has treated the task as a sequence labeling problem using hierarchical deep neural networks. |
| Approach: | They propose a hierarchical deep neural network to model different levels of utterance and dialogue act semantics and use contextual dependencies to improve performance. |
| Outcome: | The proposed model improves on the Switchboard Dialogue Act Corpus while maintaining high accuracy. |
Dial-In LLM: Human-Aligned LLM-in-the-loop Intent Clustering for Customer Service Dialogues (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing intent clustering methods rely on embedding distance metrics and neglect of underlying semantic structures. |
| Approach: | They propose an LLM-in-the-loop framework that integrates language understanding capabilities into conventional clustering algorithms. |
| Outcome: | The proposed framework outperforms baselines in Chinese and improves quality, cost efficiency and downstream applications. |
Task-Oriented Clustering for Dialogues (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for task-oriented dialogue clustering are difficult to apply directly due to inherent differences between them. |
| Approach: | They propose a Dialogue Task Clustering Network model for task-oriented clustering . they use context-aware utterance representations and cross-dialogue utterrance cluster representations . |
| Outcome: | The proposed model outperforms baselines on three public datasets on all metrics. |
Intent Detection and Discovery from User Logs via Deep Semi-Supervised Contrastive Clustering (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing approaches to intent detection rely on epoch wise clustering and classification based on labeled and unlabeled data. |
| Approach: | They propose an end-to-end deep contrastive clustering algorithm that jointly updates model parameters and cluster centers via supervised and self-supervised learning. |
| Outcome: | The proposed approach outperforms baselines on five public datasets and human-in-the-loop variant for practical deployment. |
SuperDialseg: A Large-scale Dataset for Supervised Dialogue Segmentation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Empirical studies show that supervised learning is extremely effective in in-domain datasets and models trained on SuperDialseg can achieve good generalization ability on out-of-domain data. |
| Approach: | They propose a supervised definition of dialogue segmentation points using document-grounded dialogues and a large-scale supervised dataset called SuperDialseg. |
| Outcome: | The proposed model can achieve good generalization ability on out-of-domain data. |
Data Augmentation and Learned Layer Aggregation for Improved Multilingual Language Understanding in Dialogue (2022.findings-acl)
Copied to clipboard
| Challenge: | Multi-SentAugment and LayerAgg are self-training methods that augment available training data with similar (automatically labelled) in-domain sentences from large monolingual Web-scale corpora. |
| Approach: | They propose to use multi-sentaugment and layeragg to improve dialogue natural language understanding across multiple languages. |
| Outcome: | The proposed methods generalise well in zero- and few-shot scenarios and leverage external unannotated data sources. |
Autocorrect in the Process of Translation — Multi-task Learning Improves Dialogue Machine Translation (2021.naacl-industry)
Copied to clipboard
| Challenge: | Existing neural machine translation models are not able to translate dialogues in real life scenarios. |
| Approach: | They propose a joint learning method to identify omission and typos and utilize context to translate dialogue utterances. |
| Outcome: | The proposed method improves translation quality by 3.2 BLEU over baselines and recovers omitted pronouns by 47.16%. |