Papers by Albert Lam
Continual Dialogue State Tracking via Reason-of-Select Distillation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing research on dialogue systems has focused on domain-specific offline systems lacking adaptation abilities. |
| Approach: | They propose a Reason-of-Select distillation method that enhances smaller models with a novel "meta-reasoning" capability. |
| Outcome: | Experiments show that the proposed method significantly improves the performance and generalization capabilities of existing models. |
New Intent Discovery with Pre-training and Contrastive Learning (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for identifying intents from unlabeled utterances are label-intensive, inefficient, and inaccurate. |
| Approach: | They propose a multi-task strategy to leverage unlabeled data and external labeled data for representation learning. |
| Outcome: | The proposed method outperforms state-of-the-art methods on three intent recognition benchmarks. |
Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent studies show that fine-tuning pre-trained language models with a small set of labeled utterances in a supervised manner is helpful, but it yields an anisotropic feature space, which may suppress the expressive power of the semantic representations. |
| Approach: | They propose to regularize supervised pre-training towards isotropy by contrastive learning and correlation matrix regularizers. |
| Outcome: | The proposed methods improve supervised pre-training by regularizing the feature space towards isotropy. |