Creation and evaluation of timelines for longitudinal user posts (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for segmenting user posts into timelines improve quality and cost of manual annotation. |
| Approach: | They propose a set of methods for segmenting longitudinal user posts into timelines likely to contain interesting moments of change in a user’s behaviour based on their online posting activity. |
| Outcome: | The proposed framework is able to evaluate two different social media datasets and compares with existing models. |
Similar Papers
Identifying Moments of Change from Longitudinal User Text (2022.acl-long)
Copied to clipboard
| Challenge: | Identifying changes in individuals’ behaviour and mood via shared content is gaining importance given the global increase in mental health disorders and the limited access to support services. |
| Approach: | They propose a task of identifying moments of change in individuals on the basis of their shared content online. |
| Outcome: | The proposed task is based on 500 manually annotated user timelines and shows that it performs best through context aware sequential modelling. |
Temporal reasoning for timeline summarisation in social media (2025.acl-long)
Copied to clipboard
| Challenge: | Existing temporal reasoning datasets focus on pair-wise event relationships. |
| Approach: | They propose a temporal reasoning dataset focused on temporal relationships among sequential events within narratives that combines temporal thinking with timeline summarisation through a knowledge distillation framework. |
| Outcome: | The proposed model achieves superior performance on mental health-related timeline summarisation tasks, highlighting the importance and generalisability of leveraging temporal reasoning to improve timeline summaries. |
From Word Sequences to Behavioral Sequences: Adapting Modeling and Evaluation Paradigms for Longitudinal NLP (2026.acl-long)
Copied to clipboard
Adithya V Ganesan, Vasudha Varadarajan, Oscar Kjell, Whitney Ringwald, Scott M. Feltman, Benjamin J. Luft, Roman Kotov, Ryan L. Boyd, H. Andrew Schwartz
| Challenge: | a longitudinal model for NLP relies on document-level evaluation to map isolated instances of language to an outcome. |
| Approach: | They propose a longitudinal model that aligns evaluation splits to generalization over people and time . they propose integrating a sequence inputs to incorporate history by default . |
| Outcome: | The proposed model improves on a dataset of 17k daily diary transcripts paired with PTSD symptom severity from 238 participants. |
NarrativeTime: Dense Temporal Annotation on a Timeline (2024.lrec-main)
Copied to clipboard
| Challenge: | e.g. TimeBank contains 1-5% of all possible tlinks, and this information is underspecified in the text. |
| Approach: | They propose a timeline-based framework that achieves full coverage of all possible TLINKs. |
| Outcome: | The proposed framework achieves full coverage of all possible TLINKs in a text. |
DTELS: Towards Dynamic Granularity of Timeline Summarization (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing timeline summarizations lack flexibility to meet diverse granularity needs . a fine-grained timeline showing the technical details is preferred for news topics . |
| Approach: | They propose a new paradigm to construct adaptive timelines based on user instructions or requirements. |
| Outcome: | The proposed timelines are informative and granularly consistent, but they struggle to generate consistent timelines. |
TSix: A Human-involved-creation Dataset for Tweet Summarization (L18-1)
Copied to clipboard
| Challenge: | a new dataset for tweet summarization is available for free. |
| Approach: | They propose a dataset for tweet summarization that uses human annotations to evaluate extractive summarizing methods. |
| Outcome: | The proposed dataset includes six events collected from Twitter . human-annotated gold-standard references facilitate evaluation, the study shows . |
Evaluating Dynamic Topic Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation measures to evaluate the progression of topics in dynamic topic models (DTMs) are difficult due to their unsupervised nature, but are crucial for detecting trends in time-indexed documents. |
| Approach: | They propose to combine topic quality and temporal consistency to evaluate the progression of topics over time in dynamic topic models. |
| Outcome: | The proposed measure correlates well with human judgment and can be used to identify changing topics and evaluate different models and LLMs. |
A Survey of Pun Generation: Datasets, Evaluations and Methodologies (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Pun generation aims to modify linguistic elements in text to produce humour or evoke double meanings. |
| Approach: | They propose to review pun generation datasets and methods across different stages . pun generation aims to produce humour or evoke double meanings . |
| Outcome: | This paper summarises both automated and human evaluation metrics used to assess the quality of pun generation. |
From Moments to Milestones: Incremental Timeline Summarization Leveraging Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Prior work on timeline summarization has neglected the potential synergy between the two forms of timelines. |
| Approach: | They propose a timeline summarization approach that leverages large language models to generate both event and topic timelines. |
| Outcome: | The proposed approach outperforms the best existing approaches in four TLS benchmarks. |
SummEval: Re-evaluating Summarization Evaluation (2021.tacl-1)
Copied to clipboard
Alexander R. Fabbri, Wojciech Kryściński, Bryan McCann, Caiming Xiong, Richard Socher, Dragomir Radev
| Challenge: | a lack of comprehensive studies on evaluation metrics for text summarization hinders progress . a new study aims to improve evaluation metrics that correlate with human judgments . |
| Approach: | They propose to re-evaluate automatic evaluation metrics and share a toolkit for evaluation . they hope to promote a more complete evaluation protocol for text summarization . |
| Outcome: | The proposed evaluation metrics are inconsistent with existing evaluation protocols. |