Hierarchical Dirichlet Gaussian Marked Hawkes Process for Narrative Reconstruction in Continuous Time Domain (D18-1)
Copied to clipboard
| Challenge: | Existing methods for reconstructing narratives and thread structures of news articles and discussions are lacking . temporal characteristics, triggering event relations, and meta information are used to solve the problem . |
| Approach: | They propose a Hierarchical Dirichlet Gaussian Marked Hawkes process for reconstructing narratives and thread structures of news articles and discussion posts. |
| Outcome: | The proposed model outperforms baseline models on real-world datasets and Wikipedia conversations. |
Similar Papers
Nonlinear Structural Equation Model Guided Gaussian Mixture Hierarchical Topic Modeling (2023.acl-long)
Copied to clipboard
| Challenge: | Existing topic models assume that topics are independent and that they are not a tree structure, which complicates the analysis. |
| Approach: | They propose a neural topic model with a Gaussian mixture prior distribution to improve the model’s ability to adapt to sparse data. |
| Outcome: | The proposed model outperforms baseline models on sparse data on a set of widely used datasets and generates more coherent topics and rational topic structures. |
HYPHEN: Hyperbolic Hawkes Attention For Text Streams (2022.acl-short)
Copied to clipboard
| Challenge: | Existing methods for text stream modeling ignore fine-grained timing irregularities and time-varying scale-free properties of texts. |
| Approach: | They propose a hyperbolic Hawkes Attention Network which learns a data-driven hyperbolical space and models irregular powerlaw excitations using a Hawke's process. |
| Outcome: | The proposed model can model online text sequences in a geometry agnostic manner. |
Sparse Parallel Training of Hierarchical Dirichlet Process Topic Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | To scale non-parametric extensions of probabilistic topic models, practitioners rely increasingly on parallel and distributed systems. |
| Approach: | They propose a data-parallel sampler that utilizes all available sources of sparsity found in natural language to control memory requirements and computational complexity. |
| Outcome: | The proposed sampler is able to train a hierarchical Dirichlet process topic model on a well-known corpus (PubMed) with 8m documents and 768m tokens, using a single multi-core machine in under four days. |
HyHTM: Hyperbolic Geometry-based Hierarchical Topic Model (2023.findings-acl)
Copied to clipboard
| Challenge: | Hierarchical Topic Models (HTMs) often produce hierarchies where lower-level topics are unrelated and not specific enough to their higher-level subjects. |
| Approach: | They propose a Hyperbolic geometry-based Hierarchical Topic Model that incorporates hierarchical information from hyperbolic geometrics to explicitly model hierarchies in topic models. |
| Outcome: | The proposed model is significantly faster and leaves a much smaller memory footprint than the best-performing baseline. |
Dirichlet Latent Variable Hierarchical Recurrent Encoder-Decoder in Dialogue Generation (D19-1)
Copied to clipboard
| Challenge: | Existing work assumes the Gaussian priors of the latent variable, which are incapable of representing complex latent variables effectively. |
| Approach: | They propose to use the Dirichlet distribution with flexible structures to characterize latent variables in place of the Gaussian priors. |
| Outcome: | The proposed model outperforms existing models on the dialogue generation task. |
CluHTM - Semantic Hierarchical Topic Modeling based on CluWords (2020.acl-main)
Copied to clipboard
| Challenge: | Hierarchical Topic modeling (HTM) exploits latent topics and relationships among them as a powerful tool for data analysis and exploration. |
| Approach: | They propose a hierarchical matrix factorization that exploits latent topics and relationships among them to create a powerful tool for data analysis and exploration. |
| Outcome: | The proposed method outperforms baselines and datasets in the vast majority of cases. |
Go Back in Time: Generating Flashbacks in Stories with Event Temporal Prompts (2022.naacl-main)
Copied to clipboard
| Challenge: | Existing systems that generate *flashbacks* are monotonic and lack explicit guidance on how to insert them. |
| Approach: | They propose to use event temporal orders to encode events as temporal prompts . they leverage a Plan-and-Write framework enhanced by reinforcement learning to generate storylines . |
| Outcome: | The proposed method generates more interesting stories with *flashbacks* while maintaining textual diversity, fluency, and temporal coherence. |
Modeling Document-level Temporal Structures for Building Temporal Dependency Graphs (2022.aacl-short)
Copied to clipboard
| Challenge: | Using news discourse profiling, we can identify temporal relationships between events and time expressions that are temporally related and otherwise difficult to locate. |
| Approach: | They propose to leverage news discourse profiling to model document-level temporal structures for building temporal dependency graphs. |
| Outcome: | The proposed model can identify distant inter-sentence event and (or) time expression pairs that are temporally related and otherwise difficult to locate. |
HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarization (2022.acl-long)
Copied to clipboard
| Challenge: | Document structure is critical for efficient information consumption, but it is difficult to encode it efficiently into the modern Transformer architecture. |
| Approach: | They propose a task which injects Hierarchical Biases foR Incorporating Document Structure into attention score calculation. |
| Outcome: | The proposed model produces better question-summary hierarchies than comparisons on hierarchy quality and content coverage, the authors show . |
Deep Dirichlet Multinomial Regression (N18-1)
Copied to clipboard
| Challenge: | supervised topic models can incorporate arbitrary document-level features to inform topic priors, but their ability to model corpora is limited by the representation and selection of these features. |
| Approach: | They propose a generative topic model that simultaneously learns document feature representations and topics. |
| Outcome: | The proposed model outperforms DMR and LDA on three datasets and human subjects judge it more representative of associated document features. |