HCL-TAT: A Hybrid Contrastive Learning Method for Few-shot Event Detection with Task-Adaptive Threshold (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for event detection have failed to address the problem of constantly emerging event types with limited data. |
| Approach: | They propose a novel method for event detection with a task-adaptive threshold . they propose to learn discriminative representations with 'two-view contrastive loss' |
| Outcome: | The proposed method achieves better results than the state-of-the-art methods on a benchmark dataset. |
Similar Papers
Learning Prototype Representations Across Few-Shot Tasks for Event Detection (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing training data for event detection are too expensive to achieve in real applications where novel event types emerge . Typical ED systems require labeled data for each predefined event type, but only a few examples are available. |
| Approach: | They propose to introduce cross-task prototypes to model relationships between training tasks in few-shot learning for event detection. |
| Outcome: | The proposed model improves on three few-shot learning datasets. |
Zero- and Few-Shot Event Detection via Prompt-Based Meta Learning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for event detection often fail to detect unseen or rare events due to the lack of domain knowledge. |
| Approach: | They propose a meta learning-based framework for zero-shot event detection that uses a prompt-based prompt and a trigger-aware soft verbalizer to efficiently project output to unseen tasks. |
| Outcome: | The proposed framework performs state-of-the-art in zero-shot and few-shot scenarios on benchmark datasets FewEvent and MAVEN. |
Adaptive Knowledge-Enhanced Bayesian Meta-Learning for Few-shot Event Detection (2021.findings-acl)
Copied to clipboard
| Challenge: | Event detection typically does not have sufficient labelled data, thus can be formulated as a few-shot learning problem. |
| Approach: | They propose a knowledge-based fewshot event detection method which introduces external event knowledge as the knowledge prior of event types. |
| Outcome: | Experiments show that the proposed method outperforms baselines by 15 F 1 points . event detection is an important task in information extraction . |
On Task-personalized Multimodal Few-shot Learning for Visually-rich Document Entity Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Visually-rich document entity retrieval (VDER) is an important topic in industrial NLP applications. |
| Approach: | They propose a task-aware meta-learning framework to tackle the problem of visually-rich document entity retrieval (VDER) they adopt a hierarchical decoder and employ contrastive learning to achieve this goal. |
| Outcome: | The proposed framework significantly improves the robustness of popular meta-learning baselines. |
Contrastive Learning for Prompt-based Few-shot Language Learners (2022.naacl-main)
Copied to clipboard
| Challenge: | a recent study has shown that GPT-3 fine-tuning models with limited examples is effective . a contrastive learning framework clusters inputs from the same class under different augmented “views” and repels those from different classes. |
| Approach: | They propose a supervised contrastive framework that clusters inputs from the same class under different augmented "views" they combine a contrastive loss with the standard masked language modeling loss in prompt-based few-shot learners . |
| Outcome: | The proposed framework improves on the state-of-the-art methods in a diverse set of 15 language tasks. |
Zero-Shot Event Detection Based on Ordered Contrastive Learning and Prompt-Based Prediction (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing zero-shot event detection methods do not work for unseen types . supervised methods require predefined event types or external tools . |
| Approach: | They propose a framework to detect events from unstructured text without annotating samples . they propose to use ordered contrastive learning and prompt-based prediction to identify trigger words . |
| Outcome: | The proposed model detects events more effectively and accurately than state-of-the-art methods. |
Few-shot Event Detection: An Empirical Study and a Unified View (2023.acl-long)
Copied to clipboard
| Challenge: | Extensive studies have been carried out on fewshot event detection (ED) however, there are noticeable discrepancies among existing methods from three aspects. |
| Approach: | They propose a unified view of ED models and a better unified baseline for fair evaluation. |
| Outcome: | The proposed framework outperforms existing methods by a large margin on three datasets. |
Few-Shot Intent Detection via Contrastive Pre-Training and Fine-Tuning (2021.emnlp-main)
Copied to clipboard
Jianguo Zhang, Trung Bui, Seunghyun Yoon, Xiang Chen, Zhiwei Liu, Congying Xia, Quan Hung Tran, Walter Chang, Philip Yu
| Challenge: | Existing methods address few-shot intent detection tasks from two perspectives: data augmentation and task-adaptive training with pre-trained models. |
| Approach: | They propose a few-shot intent detection schema using contrastive pre-training and fine-tuning. |
| Outcome: | The proposed method achieves state-of-the-art performance on three challenging intent detection datasets under 5-shot and 10-shot settings. |
PROTAUGMENT: Unsupervised diverse short-texts paraphrasing for intent detection meta-learning (2021.acl-long)
Copied to clipboard
| Challenge: | Recent research considers few-shot intent detection as a meta-learning problem because of labeled data scarcity and the number of classes involved. |
| Approach: | They propose a meta-learning algorithm for short texts classification that limits overfitting on the bias introduced by the few-shots classification objective at each episode. |
| Outcome: | The proposed algorithm limits overfitting on the bias introduced by the few-shots classification objective at each episode. |
The Art of Prompting: Event Detection based on Type Specific Prompts (2023.acl-short)
Copied to clipboard
| Challenge: | Experimental results show that a well-defined and comprehensive description of event types can significantly improve event detection performance when the annotations are limited. |
| Approach: | They propose a unified framework to integrate event type specific prompts for supervised, few-shot and zero-shot event detection. |
| Outcome: | The proposed framework shows up to 22.2% gain over the prior state-of-the-art frameworks. |