Forecasting Future International Events: A Reliable Dataset for Text-Based Event Modeling (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches for text-based event prediction are limited in quality due to dynamic nature of international relations and conflicting economic dynamics. |
| Approach: | They propose a novel dataset that leverages the advanced reasoning capabilities of large-language models to address these limitations. |
| Outcome: | The proposed dataset features high-quality scoring labels generated through advanced prompt modeling and rigorously validated by domain experts in political science. |
Similar Papers
OpenForecast: A Large-Scale Open-Ended Event Forecasting Dataset (2025.coling-main)
Copied to clipboard
| Challenge: | Existing closed-ended event forecasting methods are constrained by a limited answer space. |
| Approach: | They introduce OpenForecast, a large-scale open-ended dataset with three open-ending event forecasting tasks and an automatic LLM-based method for complex events. |
| Outcome: | The proposed method can be used to evaluate the ability of complex event forecasting of large language models. |
Can Language Models Serve as Text-Based World Simulators? (2024.acl-short)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have pointed towards an alternative approach by leveraging the huge amount of knowledge contained in their pre-training datasets. |
| Approach: | They build and use a benchmark to quantify how well text-based simulators can serve as text-driven world simulators. |
| Outcome: | The proposed benchmark aims to quantify how well language models can serve as world simulators. |
Event-Centric Natural Language Processing (2021.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial will provide an introduction to various methods for automating the extraction, conceptualization and prediction of events and their relations. |
| Approach: | This tutorial will provide an introduction to various methods for automating events and their relations, and a wide range of NLU and commonsense understanding tasks. |
| Outcome: | This tutorial will provide an introduction to various methods for automating extraction, conceptualization and prediction of events and their relations, and a wide range of NLU and commonsense understanding tasks. |
EvEntS ReaLM: Event Reasoning of Entity States via Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to model event implications fail to reason about the world, despite their knowledge of physical attributes. |
| Approach: | They propose to use a model prompting technique to prompt models of event implications by targeting their understanding of physical attributes. |
| Outcome: | The proposed model prompting technique is especially useful for unseen attributes or when only limited data is available. |
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment. |
| Approach: | They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge. |
| Outcome: | The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses. |
DEIE: Benchmarking Document-level Event Information Extraction with a Large-scale Chinese News Dataset (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing event-based datasets mainly target sentence-level tasks . current models struggle with "document" annotation, a key feature of the current model . |
| Approach: | They propose a large-scale document-level event information extraction dataset with over 56,000+ events and 242,000+ arguments. |
| Outcome: | The proposed dataset has over 56,000+ events and 242,000+ arguments. |
An Efficient Retrieval-Based Method for Tabular Prediction with LLM (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods for tabular prediction rely on extensive pre-training or fine-tuning of LLMs . a retrieval-based approach eliminates the need for training any modules or performing data augmentation . |
| Approach: | They propose a retrieval-based approach that utilizes the powerful capabilities of large language models in representation, comprehension, and inference. |
| Outcome: | The proposed method exhibits strong predictive performance on tabular prediction task, affirming its practicality and effectiveness. |
Evaluating Large Language Models on Time Series Feature Understanding: A Comprehensive Taxonomy and Benchmark (2024.emnlp-main)
Copied to clipboard
Elizabeth Fons, Rachneet Kaur, Soham Palande, Zhen Zeng, Tucker Balch, Manuela Veloso, Svitlana Vyetrenko
| Challenge: | Large Language Models (LLMs) are a critical tool for time series analysis and reporting in many fields, including healthcare, finance, climate, and many more. |
| Approach: | They propose a framework for rigorously evaluating the capabilities of Large Language Models (LLMs) on time series understanding, encompassing both univariate and multivariate forms. |
| Outcome: | The proposed framework delineates various characteristics inherent in time series data. |
How to Contextualize Empirical Data for Risk Analysis with LLMs: A Case Study of Power Outages (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly being considered for high-stakes decision-making, yet their application in statistical risk analysis remains largely underexplored. |
| Approach: | They propose a method for extracting key information from raw data and translating it into structured contextual input within the LLM prompt. |
| Outcome: | The proposed approach significantly improves the LLM’s performance in risk assessment tasks. |
Inferring Events from Time Series using Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Prior work on reasoning about time series in conjunction with natural language has largely overlooked event descriptions and focused on tasks involving just numeric data like trend analysis or anomaly detection. |
| Approach: | They propose a method for generating tasks that test a model’s ability to reason about events associated with time series data based on sports data and develop a benchmarking method. |
| Outcome: | The proposed method can infer unobserved events from time series data, even when providing minimal context. |