Dynamic and Static Topic Model for Analyzing Time-Series Document Collections (P18-2)
Copied to clipboard
| Challenge: | a collection of documents often has dynamic structures, i.e., topics evolve along time depending on multiple topics in the past. |
| Approach: | They propose a dynamic and static topic model that considers dynamic and dynamic structures of topic evolution and static structures of the topic hierarchy at each time. |
| Outcome: | The proposed model outperforms conventional models on scientific papers . it shows that extracted topic structures are useful for analyzing research activities . |
Similar Papers
Modeling Dynamic Topics in Chain-Free Fashion by Evolution-Tracking Contrastive Learning and Unassociated Word Exclusion (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing dynamic topic models lack the ability to reveal the evolution of topics . Existing models suffer from repetitive topic and unassociated topic issues . |
| Approach: | They propose a new evolution-tracking contrastive learning method that builds the similarity relations among dynamic topics and an unassociated word exclusion method to avoid unassociated topics. |
| Outcome: | The proposed model outperforms state-of-the-art models on downstream tasks and is robust to evolution intensities. |
Deep Temporal-Recurrent-Replicated-Softmax for Topical Trends over Time (N18-1)
Copied to clipboard
| Challenge: | a novel topic model is proposed to allow topical trends to be captured in temporal collections of documents. |
| Approach: | They propose a novel unsupervised neural dynamic topic model where topics are influenced by topic discovery over time. |
| Outcome: | The proposed model shows better generalization, topic interpretation, evolution and trends compared to state-of-the-art models . |
Dynamic Structured Neural Topic Model with Self-Attention Mechanism (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent topic models that capture the time-series evolution of topics assume that topics evolve independently without interaction. |
| Approach: | They propose a dynamic structured neural topic model which captures topic dependencies while capturing their dependencies. |
| Outcome: | The proposed model outperforms a prior dynamic embedded topic model regarding perplexity and coherence while maintaining sufficient diversity across topics. |
Dynamic Topic Modeling by Clustering Embeddings from Pretrained Language Models: A Research Proposal (2022.aacl-srw)
Copied to clipboard
| Challenge: | Neural Topic Models (NTMs) are topic models that are created with the help of a pretrained language model. |
| Approach: | They propose to do Neural Topic Modeling by Clustering document Embeddings (NTM-CE) with a pretrained language model to create dynamic topic models. |
| Outcome: | The proposed model can be evaluated theoretically and practically using quantitative measurements of coherence and human evaluation to evaluate the model. |
Evaluating Dynamic Topic Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation measures to evaluate the progression of topics in dynamic topic models (DTMs) are difficult due to their unsupervised nature, but are crucial for detecting trends in time-indexed documents. |
| Approach: | They propose to combine topic quality and temporal consistency to evaluate the progression of topics over time in dynamic topic models. |
| Outcome: | The proposed measure correlates well with human judgment and can be used to identify changing topics and evaluate different models and LLMs. |
Modeling Document-level Temporal Structures for Building Temporal Dependency Graphs (2022.aacl-short)
Copied to clipboard
| Challenge: | Using news discourse profiling, we can identify temporal relationships between events and time expressions that are temporally related and otherwise difficult to locate. |
| Approach: | They propose to leverage news discourse profiling to model document-level temporal structures for building temporal dependency graphs. |
| Outcome: | The proposed model can identify distant inter-sentence event and (or) time expression pairs that are temporally related and otherwise difficult to locate. |
Beyond Coherence: Improving Temporal Consistency and Interpretability in Dynamic Topic Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing topic models capture bag-of-words statistics but lack semantic priors . interpretability remains shallow, relying on noisy top-word lists that obscure thematic clarity. |
| Approach: | They propose a variational framework to capture more faithful temporal trajectories . they propose to use entropy-regularized optimal transport to align entire topic constellations . |
| Outcome: | The proposed framework captures more faithful temporal trajectories and improves interpretability. |
DynaMiTE: Discovering Explosive Topic Evolutions with User Guidance (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing Dynamic topic models are either fully supervised, requiring expensive human annotations, or fully unsupervised, producing topic evolutions that often do not cater to a user’s needs. |
| Approach: | They propose to use a framework that ensembles semantic similarity, category indicative, and time indicative scores to produce informative topic evolutions. |
| Outcome: | The proposed framework can be used to discover topic evolutions from temporal corpora that align with user-provided category names and uniquely capture topics at each time step. |
Leveraging Collection-Wide Similarities for Unsupervised Document Structure Extraction (2024.findings-acl)
Copied to clipboard
| Challenge: | Document collections of various domains share some underlying collection-wide structure . structure can be useful in various use cases across different domains, such as legal, medical, or financial . |
| Approach: | They propose to identify the typical structure of document within a collection by using header paraphrases to ground topics to respective document locations. |
| Outcome: | The proposed method extracts meaningful collection-wide structure from documents in three domains in English and Hebrew. |
DCT-Centered Temporal Relation Extraction (2022.coling-1)
Copied to clipboard
| Challenge: | Existing work on temporal relation extraction focuses on extracting temporal relations between events . previous work on relation extraction focused on focusing on event-centered tasks . |
| Approach: | They propose a temporal relation extraction model that unifies events, timexes and DCT . they propose combining event mentions, time expressions and document creation time into a sentence-style model . |
| Outcome: | The proposed model outperforms baselines on E-E, E-T and E-D significantly. |