Generative Zero-Shot Prompt Learning for Cross-Domain Slot Filling with Inverse Prompting (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to slot filling only learn surface mapping of slot types between D S and D T and get poor generalization capability or robustness. |
| Approach: | They propose a generative zero-shot prompt learning framework for cross-domain slot filling which improves generalization and robustness than previous work. |
| Outcome: | The proposed framework improves generalization and robustness on unseen slots and an efficient prompt tuning strategy boosts performance. |
Similar Papers
Inverse is Better! Fast and Accurate Prompt for Few-shot Slot Tagging (2022.findings-acl)
Copied to clipboard
| Challenge: | Recent results show that prompting methods are inefficient for slot tagging tasks . inverse prompting only requires a one-turn prediction for each slot type . |
| Approach: | They propose an inverse prompting paradigm that reversely predicts slot values given slot types . the method is faster and significantly improves the effect on 10-shot setting . |
| Outcome: | The proposed method improves over 6.1 F1-scores on 10-shot setting and achieves new state-of-the-art performance. |
Robust Zero-Shot Cross-Domain Slot Filling with Example Values (P19-1)
Copied to clipboard
| Challenge: | Task-oriented dialog systems rely on deep learning-based slot filling models . little to no training data for target domains may be available or schemas may not be aligned . |
| Approach: | They propose to use slot descriptions and examples of slot values to learn slot semantic representations that are transferable across domains and robust to misaligned schemas. |
| Outcome: | The proposed model outperforms state-of-the-art models on two multi-domain datasets on low-data setting. |
Contrastive Zero-Shot Learning for Cross-Domain Slot Filling with Adversarial Attack (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches to zero-shot slot filling ignore constraints in the latent space and lack robustness. |
| Approach: | They propose a Contrastive Zero-Shot Learning with Adversarial Attack method for slot filling . they propose to map slot value contextual representations to slot description representations . |
| Outcome: | The proposed method outperforms state-of-the-art models under zero-shot and few-shot settings. |
Bridge to Target Domain by Prototypical Contrastive Learning and Label Confusion: Re-explore Zero-Shot Learning for Slot Filling (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for zero-shot cross-domain slot filling do not achieve effective knowledge transfer to the target domain. |
| Approach: | They propose a novel approach based on prototypical contrastive learning and a dynamic label confusion strategy for zero-shot slot filling. |
| Outcome: | The proposed model improves on unseen slots while setting new state-of-the-arts on slot filling task. |
QA-Driven Zero-shot Slot Filling with Weak Supervision Pretraining (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods to predict slots and their values do not encode enough semantic information, limiting the models’ zero-shot capability. |
| Approach: | They propose a QA-driven slot filling model which extracts slot-filler spans from utterances with a span-based QA model. |
| Outcome: | The proposed model outperforms baselines by over 5% on the SNIPS benchmark. |
Adaptive End-to-End Metric Learning for Zero-Shot Cross-Domain Slot Filling (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent research on slot filling has witnessed considerable improvement with considerable data and label shifts. |
| Approach: | They propose an adaptive end-to-end metric learning scheme for zero-shot slot filling that uses context-aware soft label representations and slot-level contrastive representation learning to mitigate the data and label shift problems. |
| Outcome: | The proposed approach outperforms existing methods on public benchmarks and shows that it is simple, efficient and generalizable. |
Leveraging Slot Descriptions for Zero-Shot Cross-Domain Dialogue StateTracking (2021.naacl-main)
Copied to clipboard
Zhaojiang Lin, Bing Liu, Seungwhan Moon, Paul Crook, Zhenpeng Zhou, Zhiguang Wang, Zhou Yu, Andrea Madotto, Eunjoon Cho, Rajen Subba
| Challenge: | Existing models for zero-shot cross-domain dialogue state tracking require in-domain data to model a new domain. |
| Approach: | They propose a slot descriptions enhanced generative approach for zero-shot cross-domain DST by encoding a dialogue context and a slots with a pre-trained encoder and generating slot value in auto-regressive manner. |
| Outcome: | The proposed model significantly improves state-of-the-art results in zero-shot cross-domain setting. |
Synergistic Augmentation: Enhancing Cross-Domain Zero-Shot Slot Filling with Small Model-Assisted Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to slot filling are limited due to data scarcity and timeconsuming efforts. |
| Approach: | They propose a framework that harnesses the power of a small model to augment inferential capabilities of LLMs without additional training. |
| Outcome: | The proposed framework improves slot filling performance on a spoken language dataset and a NER dataset. |
Slot Dependency Modeling for Zero-Shot Cross-Domain Dialogue State Tracking (2022.coling-1)
Copied to clipboard
| Challenge: | Existing zero-shot learning methods ignore slot dependencies in a multidomain dialogue . experimental results show the effectiveness of our proposed method over existing state-of-art generation methods . |
| Approach: | They propose to use slot prompts combination, slot values demonstration and slot constraint object to model slot-slot dependency, slot-value dependency and slot-context dependency respectively. |
| Outcome: | The proposed method outperforms state-of-the-art methods under zero-shot/few-shot settings. |
HierarchicalContrast: A Coarse-to-Fine Contrastive Learning Framework for Cross-Domain Zero-Shot Slot Filling (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing zero-shot slot filling methods show limited generalization ability in target domain . et al., 2018: empirical results show that proposed method is better than existing methods . |
| Approach: | They propose a hierarchical contrastive learning framework for zero-shot slot filling . they use Gaussian-distributed embedding to learn generalized deep semantic relations . |
| Outcome: | The proposed method performs better than existing methods on unseen slot types . empirical results show that the proposed method can generalize to unseense slot types. |