| Challenge: | Existing temporal relation (TempRel) annotation schemes have low inter-annotator agreements even between experts, suggesting that the current annotation task needs a better definition. |
| Approach: | They propose to annotate temporal relation (TempRel) annotation schemes based on event start-points instead of a conventional 60’s-80’s model. |
| Outcome: | The proposed model improves IAA from the conventional 60’s to 80’s and can be used by crowdsourcing to alleviate labor intensity. |
Similar Papers
QA-based Event Start-Points Ordering for Clinical Temporal Relation Annotation (2024.lrec-main)
Copied to clipboard
| Challenge: | Temporal relation annotation in the clinical domain is crucial but challenging due to its workload and the medical expertise required. |
| Approach: | They propose an annotation method that integrates event start-points ordering and question-answering as the annotation format. |
| Outcome: | The proposed method achieves a 0.72 F1 score and enables collaboration among medical experts and non-experts. |
TIMELINE: Exhaustive Annotation of Temporal Relations Supporting the Automatic Ordering of Events in News Articles (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing temporal relation extraction models have low inter-annotator agreement due to lack of specificity of annotation guidelines . authors propose a method for annotating all temporal relations, including long-distance ones, which automates the process . |
| Approach: | They propose a new annotation scheme that defines criteria for temporal relations to be annotated . scheme includes events even if they are not expressed as verbs, they argue . |
| Outcome: | The proposed method reduces time and manual effort on the part of annotators. |
Comprehensive Annotation of Various Types of Temporal Information on the Time Axis (L18-1)
Copied to clipboard
| Challenge: | Existing studies linking event and time information have been conducted to train and evaluate models. |
| Approach: | They propose an annotation scheme that anchors expressions in text to the time axis comprehensively. |
| Outcome: | The proposed scheme can be utilized for integrated information analysis of events, entities and time. |
Fine-Grained Temporal Relation Extraction (P19-1)
Copied to clipboard
| Challenge: | Existing methods for temporal relations and event durations are insufficient for determining the fine-grained temporal structure of complex events. |
| Approach: | They propose a semantic framework for temporal relations and event durations that maps pairs of events to real-valued scales. |
| Outcome: | The proposed framework can predict fine-grained temporal relations and event durations . it can be applied to the entire English Web Treebank dataset . |
NarrativeTime: Dense Temporal Annotation on a Timeline (2024.lrec-main)
Copied to clipboard
| Challenge: | e.g. TimeBank contains 1-5% of all possible tlinks, and this information is underspecified in the text. |
| Approach: | They propose a timeline-based framework that achieves full coverage of all possible TLINKs. |
| Outcome: | The proposed framework achieves full coverage of all possible TLINKs in a text. |
Inducing Temporal Relations from Time Anchor Annotation (N18-1)
Copied to clipboard
| Challenge: | Existing methods for judging temporal relations are limited to “salient” event pairs or on pairs in a fixed window of sentences. |
| Approach: | They propose a new method to obtain temporal relations from absolute time value (a.k.a. time anchors) they start from time anchor for events and time expressions and induced temporal relation annotations automatically . |
| Outcome: | The proposed method shows that it requires less annotation effort and induces inter-sentence relations easily. |
Joint Event and Temporal Relation Extraction with Shared Representations and Structured Prediction (D19-1)
Copied to clipboard
| Challenge: | Existing systems treat this task as a pipeline of two separate subtasks, i.e., event extraction and temporal relation classification. |
| Approach: | They propose a joint event and temporal relation extraction model with shared representation learning and structured prediction. |
| Outcome: | The proposed method improves both event extraction and temporal relation extraction over state-of-the-art systems. |
More than Classification: A Unified Framework for Event Temporal Relation Extraction (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for event temporal relation extraction ignore meaning of relations and wipe out their intrinsic dependency. |
| Approach: | They propose a unified event temporal relation extraction framework that transforms temporal relations into logical expressions of time points and completes the ETRE by predicting the relations between certain time points. |
| Outcome: | The proposed framework outperforms the state-of-the-art model on TB-Dense and MATRES by 0.3% on both datasets. |
Structured Interpretation of Temporal Relations (L18-1)
Copied to clipboard
| Challenge: | Temporal relations between events and time expressions are often modeled in an unstructured manner, resulting in inconsistent and incomplete annotation and computational modeling. |
| Approach: | They propose an annotation approach where events and time expressions form a dependency tree in which each dependency relation corresponds to an instance of temporal anaphora. |
| Outcome: | The proposed approach annotates 235 documents in news and narratives with 48 doubly annotated documents. |
Utilizing Relative Event Time to Enhance Event-Event Temporal Relation Extraction (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for event-event temporal relation extraction are sparse on event-time information. |
| Approach: | They propose a model for event-event temporal relation classification and an auxiliary task, relative event time prediction, which predicts the event time as real numbers. |
| Outcome: | The proposed model significantly improves the RoBERTa-based baseline and achieves state-of-the-art performance on MATRES dataset. |