Zero-shot Event Extraction via Transfer Learning: Challenges and Insights (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods for event extraction require expensive annotation and are not extensible to new event ontologies. |
| Approach: | They propose to use textual entailment and/or question answering queries to extract a zero-shot event from a set of TE and/ or QA queries. |
| Outcome: | The proposed method achieves acceptable results on ACE-2005 and ERE, but there is still a large gap from supervised approaches. |
Similar Papers
Zero-Shot Transfer Learning for Event Extraction (P18-1)
Copied to clipboard
| Challenge: | Existing supervised event extraction methods rely on manual annotations and features specific to each event type. |
| Approach: | They propose a framework that maps event mentions to a specific type in an event ontology . they use existing annotations to extract event types from unstructured text data . |
| Outcome: | The proposed framework can be applied to new unseen event types without manual annotations. |
Evaluating Zero-Shot Event Structures: Recommendations for Automatic Content Extraction (ACE) Annotations (2023.acl-short)
Copied to clipboard
| Challenge: | Zero-shot event extraction (EE) methods infer richly structured event records from unstructured text data, based on a user-supplied natural language specification and no training examples. |
| Approach: | They propose recommendations for future evaluations so the research community can better utilize ACE as an event evaluation resource. |
| Outcome: | The proposed methods can be used to evaluate zero-shot and other low-supervision EE methods, considering up to 32% of correctly identified arguments and 25% of correctly ignored event mentions as false negatives. |
Event Extraction by Answering (Almost) Natural Questions (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing work in event argument extraction relies heavily on entity recognition as a preprocessing/concurrent step, causing error propagation. |
| Approach: | They propose a question answering task that extracts event arguments in an end-to-end manner. |
| Outcome: | The proposed framework outperforms prior work on the ACE 2005 task on event argument extraction. |
Improving Event Definition Following For Zero-Shot Event Detection (2024.acl-long)
Copied to clipboard
Zefan Cai, Po-Nien Kung, Ashima Suvarna, Mingyu Ma, Hritik Bansal, Baobao Chang, P. Jeffrey Brantingham, Wei Wang, Nanyun Peng
| Challenge: | Existing approaches on zero-shot event detection train models on datasets annotated with known event types and prompt them with unseen event definitions. |
| Approach: | They propose to train models to better follow event definitions by using an automatic generated Diverse Event Definition dataset. |
| Outcome: | The proposed model outperforms existing models on three open benchmarks on zero-shot event detection. |
Query and Extract: Refining Event Extraction as Type-oriented Binary Decoding (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to event extraction are limited to a set of pre-defined types. |
| Approach: | They propose a natural language query framework that uses event types and argument roles to extract candidate triggers and arguments from input text. |
| Outcome: | The proposed framework outperforms existing methods on zero-shot event extraction. |
Zero-shot Event Detection Using a Textual Entailment Model as an Enhanced Annotator (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent work proposed to use a pre-trained textual entailment model for event detection . but, those methods treated the TE model as a frozen annotator . |
| Approach: | They propose to use TE models to annotate large-scale unlabeled text and annotated data to fine-tune the TE model. |
| Outcome: | The proposed method outperforms baseline methods by 15% on the ACE05 dataset. |
Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learning (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent work shows that Relation Extraction tasks can be recasted as Textual Entailment tasks using verbalizations. |
| Approach: | They propose to recasted RE tasks as Textual Entailment tasks using verbalizations . they show that entailment reduces the need for manual annotation to 50% and 20% . |
| Outcome: | The proposed method reduces the need for manual annotation to 50% and 20% in event argument extraction tasks while achieving the same performance as with full training. |
Zero-shot Label-Aware Event Trigger and Argument Classification (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing work on event extraction relies on labor-intensive annotation, ignoring semantic meaning of event types' labels. |
| Approach: | They propose a zero-shot event extraction approach that first identifies events with existing tools and then maps them to a given taxonomy of event types in a no-shot manner. |
| Outcome: | The proposed approach doubles the performance of previous approaches on a ACE-2005 dataset . it leverages label representations induced by pre-trained language models and maps events to the target types . |
Zero-Shot Dialogue State Tracking via Cross-Task Transfer (2021.emnlp-main)
Copied to clipboard
Zhaojiang Lin, Bing Liu, Andrea Madotto, Seungwhan Moon, Zhenpeng Zhou, Paul Crook, Zhiguang Wang, Zhou Yu, Eunjoon Cho, Rajen Subba, Pascale Fung
| Challenge: | Existing approaches to training a dialogue state tracking model require extensive annotated dialogue data. |
| Approach: | They propose to transfer cross-task knowledge from general question answering corpora to QA model that can handle zero-shot DST. |
| Outcome: | The proposed model improves existing zero-shot and few-shot results on MultiWoz and shows better generalization ability in unseen domains. |
Event Extraction as Question Generation and Answering (2023.acl-short)
Copied to clipboard
| Challenge: | Recent work on Event Extraction addresses the error propagation issue found in token-based classification approaches. |
| Approach: | They propose a Question Generation (QG) model that generates questions that leverage contextual information instead of fixed templates. |
| Outcome: | The proposed model outperforms all previous single-task-based models on the ACE05 English dataset. |