OpenForecast: A Large-Scale Open-Ended Event Forecasting Dataset (2025.coling-main)
Copied to clipboard
| Challenge: | Existing closed-ended event forecasting methods are constrained by a limited answer space. |
| Approach: | They introduce OpenForecast, a large-scale open-ended dataset with three open-ending event forecasting tasks and an automatic LLM-based method for complex events. |
| Outcome: | The proposed method can be used to evaluate the ability of complex event forecasting of large language models. |
Similar Papers
Forecasting Future International Events: A Reliable Dataset for Text-Based Event Modeling (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches for text-based event prediction are limited in quality due to dynamic nature of international relations and conflicting economic dynamics. |
| Approach: | They propose a novel dataset that leverages the advanced reasoning capabilities of large-language models to address these limitations. |
| Outcome: | The proposed dataset features high-quality scoring labels generated through advanced prompt modeling and rigorously validated by domain experts in political science. |
ForestCast: Open-Ended Event Forecasting with Semantic News Forest (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches and datasets overlook the complex relationships among events . current research lacks comprehensive evaluation methods to evaluate OEEF . |
| Approach: | They propose a prediction pipeline that extracts forecast-relevant events from news data . forestcast organizes news events into a story tree and predicts subsequent events along each path . |
| Outcome: | The proposed pipeline extracts forecast-relevant events from news data and predicts subsequent events along each path. |
DEIE: Benchmarking Document-level Event Information Extraction with a Large-scale Chinese News Dataset (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing event-based datasets mainly target sentence-level tasks . current models struggle with "document" annotation, a key feature of the current model . |
| Approach: | They propose a large-scale document-level event information extraction dataset with over 56,000+ events and 242,000+ arguments. |
| Outcome: | The proposed dataset has over 56,000+ events and 242,000+ arguments. |
Analyzing Temporal Complex Events with Large Language Models? A Benchmark towards Temporal, Long Context Understanding (2024.acl-long)
Copied to clipboard
| Challenge: | Existing research in complex event analysis has made significant strides but is constrained by inadequate natural language processing techniques. |
| Approach: | They propose a novel approach using Large Language Models to extract and analyze the event chain within TCE, characterized by their key points and timestamps. |
| Outcome: | The proposed model performs comparable to models with long context window and retrieval-augmented generation method in three distinct tasks . |
EXCEEDS: Extracting Complex Events via Nugget-based Grid Modeling in Scientific Domain (2026.acl-long)
Copied to clipboard
| Challenge: | Extensive event extraction research has been conducted in many domains, including news, finance, and biology. |
| Approach: | They propose an end-to-end scientific event extraction framework for encoding nuggets into a grid matrix and simplifying complex event extraction as a nuggot-based grid modeling task. |
| Outcome: | The proposed framework performs well in scientific domain, demonstrating state-of-the-art performance. |
Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators (2026.findings-acl)
Copied to clipboard
| Challenge: | State-of-the-art NLP models are expensive and inefficient for event annotation. |
| Approach: | They propose to integrate LLMs into a holistic workflow that summarizes news with event coreference resolution and argument extraction in three modes: AI-only, AI assistance, and human only. |
| Outcome: | The proposed workflow integrates LLMs to alleviate human labor in a holistic pipeline. |
Open Domain Event Extraction Using Neural Latent Variable Models (P19-1)
Copied to clipboard
| Challenge: | Existing work on extracting events from news documents focuses on a set of pre-specified event types. |
| Approach: | They propose a latent variable neural model which is scalable to large corpus. |
| Outcome: | The proposed model performs better than the state-of-the-art method for event schema induction. |
Towards Event Extraction with Massive Types: LLM-based Collaborative Annotation and Partitioning Extraction (2025.emnlp-main)
Copied to clipboard
| Challenge: | Event Extraction (EE) is a long-standing target, but lacks an efficient and effective annotation framework to construct the corresponding datasets. |
| Approach: | They propose an LLM-based collaborative annotation framework that refines annotations of triggers from distant supervision and carries out argument annotation. |
| Outcome: | The proposed framework outperforms state-of-the-art methods on the largest EE dataset to date . it achieves the F1 scores of 90% and 85.3% on the human-annotated test set . |
Text2Event: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods to extract event records from text decompose complex structure prediction task into multiple subtasks. |
| Approach: | They propose a sequence-to-structure generation paradigm that can extract events from text . they propose unified event extraction, constrained decoding algorithm and curriculum learning algorithm . |
| Outcome: | The proposed method can achieve competitive performance using record-level annotations in both supervised learning and transfer learning settings. |
Scattered Hypothesis Generation for Open-Ended Event Forecasting (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for event forecasting focus on the most probable outcomes, neglecting the intrinsic uncertainty of real-world events. |
| Approach: | They propose a reinforcement learning framework that optimizes inclusiveness and diversity of the hypothesis by integrating validity-gated score into the overall objective. |
| Outcome: | The proposed framework outperforms baselines on two real-world benchmark datasets. |