Don’t Annotate, but Validate: a Data-to-Text Method for Capturing Event Data (L18-1)
Copied to clipboard
| Challenge: | Existing methods to create event data are limited by ambiguity and variation in the data. |
| Approach: | They propose a method to obtain large volumes of text corpora with event data . they use a tool to annotate texts and enrich the reference texts with event coreference annotations. |
| Outcome: | The proposed method obtains large volumes of high-quality text corpora with event data . the data obtained with this method have high precision and at a large scale . |
Similar Papers
The Coreference under Transformation Labeling Dataset: Entity Tracking in Procedural Texts Using Event Models (2023.findings-acl)
Copied to clipboard
| Challenge: | et al., 2023) show that entity coreference resolution is improved when events bring about changes in entities that are not reflected in text mentions. |
| Approach: | They propose to perform transformation-based entity linking prior to coreference relation identification to improve entity coreference. |
| Outcome: | The proposed model improves coreference resolution of entities mentioned under a process-oriented model of events. |
ezCoref: Towards Unifying Annotation Guidelines for Coreference Resolution (2023.findings-eacl)
Copied to clipboard
Ankita Gupta, Marzena Karpinska, Wenlong Zhao, Kalpesh Krishna, Jack Merullo, Luke Yeh, Mohit Iyyer, Brendan O’Connor
| Challenge: | Existing datasets vary in definition of coreferences and are curated for linguistic experts. |
| Approach: | They propose to use ezCoref to create a crowdsourcing-friendly coreference annotation methodology that teaches annotators only cases that are treated similarly across existing datasets. |
| Outcome: | The proposed method reannotates 240 passages from seven existing english coreference datasets while teaching annotators only cases that are treated similarly across them. |
Automatic Data Acquisition for Event Coreference Resolution (2021.eacl-main)
Copied to clipboard
| Challenge: | lexical paraphrases and high precision rules informed by news discourse structure can be used to collect coreferential and non-coreferential event pairs from unlabeled English news articles. |
| Approach: | They propose to use lexical paraphrases and news discourse structure to automatically collect coreferential and non-coreferential event pairs from unlabeled English news articles. |
| Outcome: | The proposed model performs better than the supervised model on evaluation datasets with different event domains and text genres. |
Cross-document coreference: An approach to capturing coreference without context (D19-62)
Copied to clipboard
| Challenge: | a cross-document coreference annotation schema was developed to extract timelines in the clinical domain. |
| Approach: | They propose a cross-document coreference annotation schema that is governed by schematic rules to create meaningful and consistent cross- document relations. |
| Outcome: | The proposed approach produces an agreement score of 93.77% for identical relations between the two sets of notes. |
Spanless Event Annotation for Corpus-Wide Complex Event Understanding (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for annotating multilingual, multimedia data are limited by the availability of multilingual corpora for schema-based event representation. |
| Approach: | They propose a new approach to event annotation to promote whole-corpus understanding of complex events in multilingual, multimedia data. |
| Outcome: | The proposed method is part of the DARPA Knowledge-directed Artificial Intelligence Reasoning Over Schemas (KAIROS) Program. |
WEC: Deriving a Large-scale Cross-document Event Coreference dataset from Wikipedia (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing datasets for cross-document event coreference resolution are limited and small . authors present a method for identifying clusters of text mentions that refer to the same event . |
| Approach: | They propose a method for generating a large-scale Wikipedia event coreference dataset . they use a generic approach that adapts state-of-the-art models to the cross-document setting . |
| Outcome: | The proposed method outperforms existing models and can be applied to other languages. |
MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction (2022.emnlp-main)
Copied to clipboard
Xiaozhi Wang, Yulin Chen, Ning Ding, Hao Peng, Zimu Wang, Yankai Lin, Xu Han, Lei Hou, Juanzi Li, Zhiyuan Liu, Peng Li, Jie Zhou
| Challenge: | Existing datasets only cover limited relation types at once, which prevents models from taking full advantage of relation interactions. |
| Approach: | They construct a large-scale human-annotated ERE dataset with improved annotation schemes to address these drawbacks. |
| Outcome: | The proposed dataset is larger than existing datasets of all the ERE tasks by at least an order of magnitude. |
Event Coreference Resolution with Non-Local Information (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing joint models for event coreference resolution are understudied and underexploited . current models only learn trigger detection and event coreference from annotated training data . |
| Approach: | They propose to add a topic-based trigger detection module and a preprocessing module to improve event coreference. |
| Outcome: | The proposed model yields the best results on the KBP 2017 English and Chinese datasets. |
Instruction-Tuning LLMs for Event Extraction with Annotation Guidelines (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing applications of large language models to IE can be categorized into two lines: prompt engineering-based approaches and instruction-tuning open-weight LLMs. |
| Approach: | They propose to use annotation guidelines to teach large language models for event extraction . they use textual descriptions of event types and arguments to train the models . |
| Outcome: | The proposed approach improves cross-schema generalization and low-frequency event-type performance when there is a decent amount of training data. |
TextEE: Benchmark, Reevaluation, Reflections, and Future Challenges in Event Extraction (2024.findings-acl)
Copied to clipboard
Kuan-Hao Huang, I-Hung Hsu, Tanmay Parekh, Zhiyu Xie, Zixuan Zhang, Prem Natarajan, Kai-Wei Chang, Nanyun Peng, Heng Ji
| Challenge: | Recent studies suggest that event extraction evaluations may not accurately reflect the true performance. |
| Approach: | They propose a standardized, fair, and reproducible benchmark for event extraction . they use standardized scripts and splits for 16 datasets spanning eight domains . |
| Outcome: | The proposed benchmarks show that they struggle to achieve satisfactory performance. |