Don’t Let Discourse Confine Your Model: Sequence Perturbations for Improved Event Language Models (2021.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to train event language models on text constrain them to follow discourse order of events. |
| Approach: | They propose a method to perturb event sequences so that they can relax model dependence on text order. |
| Outcome: | The proposed technique improves performance on applications and out-of-domain events data. |
Similar Papers
Generating Temporally-ordered Event Sequences via Event Optimal Transport (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for temporal event ordering and event infilling ignore the global semantics of events, and the model adopts a word-level objective to model events in texts. |
| Approach: | They propose a temporal event ordering and event infilling task using a model that uses maximum likelihood estimation to model events in texts. |
| Outcome: | The proposed model outperforms existing models on all evaluation datasets. |
Set-Aligning Framework for Auto-Regressive Event Temporal Graph Generation (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing methods for constructing event temporal graphs have been suboptimal . authors propose a set-aligning framework for the effective utilisation of Large Language Models . |
| Approach: | They propose a set-aligning framework for the effective utilisation of Large Language Models to alleviate text generation loss penalties. |
| Outcome: | The proposed framework surpasses existing baselines for event temporal graph generation. |
Instruction-Tuning LLMs for Event Extraction with Annotation Guidelines (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing applications of large language models to IE can be categorized into two lines: prompt engineering-based approaches and instruction-tuning open-weight LLMs. |
| Approach: | They propose to use annotation guidelines to teach large language models for event extraction . they use textual descriptions of event types and arguments to train the models . |
| Outcome: | The proposed approach improves cross-schema generalization and low-frequency event-type performance when there is a decent amount of training data. |
Augmentation, Retrieval, Generation: Event Sequence Prediction with a Three-Stage Sequence-to-Sequence Approach (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to predict event sequences are complex and ignore the knowledge of external events. |
| Approach: | They propose a statistical induction problem to generate a sequence of events by exploring the similarity between the given goal and known sequences of events. |
| Outcome: | The proposed model outperforms existing methods on an event sequence prediction task. |
Event-Centric Natural Language Processing (2021.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial will provide an introduction to various methods for automating the extraction, conceptualization and prediction of events and their relations. |
| Approach: | This tutorial will provide an introduction to various methods for automating events and their relations, and a wide range of NLU and commonsense understanding tasks. |
| Outcome: | This tutorial will provide an introduction to various methods for automating extraction, conceptualization and prediction of events and their relations, and a wide range of NLU and commonsense understanding tasks. |
Emancipating Event Extraction from the Constraints of Long-Tailed Distribution Data Utilizing Large Language Models (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for EE depend on manual annotations, which are expensive and scarce. |
| Approach: | They propose to transform the event extraction task into multi-turn dialogues and a novel method for generating high-quality data. |
| Outcome: | The proposed methods significantly improve existing models’ performance with various paradigms and structures, especially on tail types. |
Severing the Edge Between Before and After: Neural Architectures for Temporal Ordering of Events (2020.emnlp-main)
Copied to clipboard
Miguel Ballesteros, Rishita Anubhai, Shuai Wang, Nima Pourdamghani, Yogarshi Vyas, Jie Ma, Parminder Bhatia, Kathleen McKeown, Yaser Al-Onaizan
| Challenge: | Existing models for temporal ordering of events rely on pretrained representations, transfer and multitask learning, and self-training techniques. |
| Approach: | They propose a neural architecture and a set of training methods for ordering events by predicting temporal relations by pre-training models. |
| Outcome: | The proposed models can predict temporal relations between two pairs of events within a span of text and identify temporal relationships between them. |
A Regularization Approach for Incorporating Event Knowledge and Coreference Relations into Neural Discourse Parsing (D19-1)
Copied to clipboard
| Challenge: | Existing approaches to discourse parsing use commonsense knowledge and linguistic constraints to integrate them into neural network models. |
| Approach: | They propose a knowledge regularization approach that integrates linguistic constraints with contexts for deriving word representations. |
| Outcome: | The proposed approach outperforms previous systems on the benchmark dataset PDTB for discourse parsing. |
Neural Language Modeling for Contextualized Temporal Graph Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for temporal reasoning have been used for a number of applications, but their potential for tempor reasoning over event graphs has not been explored. |
| Approach: | They propose to use large-scale pre-trained language models to generate an event-level temporal graph from a document using existing IE/NLP tools. |
| Outcome: | The proposed method outperforms the closest existing method on several metrics on a hand-labeled, out-of-domain corpus. |
From Moments to Milestones: Incremental Timeline Summarization Leveraging Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Prior work on timeline summarization has neglected the potential synergy between the two forms of timelines. |
| Approach: | They propose a timeline summarization approach that leverages large language models to generate both event and topic timelines. |
| Outcome: | The proposed approach outperforms the best existing approaches in four TLS benchmarks. |