Unsupervised Hierarchical Topic Modeling via Anchor Word Clustering and Path Guidance (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing hierarchical topic models often ignore the role of anchor words that guide text generation. |
| Approach: | They propose to use a clustering algorithm to detect anchor words that are highly consistent with every topic and add a causal path to the popular Variational Auto-Encoder framework. |
| Outcome: | The proposed model outperforms state-of-the-art methods on three datasets. |
Similar Papers
Neural Attention-Aware Hierarchical Topic Model (2021.emnlp-main)
Copied to clipboard
| Challenge: | Neural topic models (NTMs) use deep neural networks to learn topic information. |
| Approach: | They propose a variational autoencoder model that reconstructs sentence and document word counts using bag-of-words embeddings and pre-trained semantic embedders. |
| Outcome: | The proposed model lowers reconstruction errors at sentence and document levels and finds more coherent topics from real-world datasets. |
Labeled Anchors and a Scalable, Transparent, and Interactive Classifier (D18-1)
Copied to clipboard
| Challenge: | Labeled Anchors is an interactive and supervised topic model based on the anchor words algorithm . |
| Approach: | They propose an interactive supervised topic model based on the anchor words algorithm . they propose a classifier which requires no training beyond topic inference . |
| Outcome: | The proposed model is human-interpretable and fast, and can be interactive. |
A Neural Generative Model for Joint Learning Topics and Topic-Specific Word Embeddings (2020.tacl-1)
Copied to clipboard
| Challenge: | Experimental results show that the proposed model outperforms word-level embedding methods in word similarity evaluation and word sense disambiguation. |
| Approach: | They propose a generative model that explores local and global context for joint learning topics and topic-specific word embeddings. |
| Outcome: | The proposed model outperforms word-level embedding methods in word similarity evaluation and word sense disambiguation. |
Why These Documents? Explainable Generative Retrieval with Hierarchical Category Paths (2026.findings-acl)
Copied to clipboard
| Challenge: | Generative retrieval directly decodes a document identifier, making it impossible to provide explanations for its retrieval decision. |
| Approach: | They propose a hierarchical category path-Enhanced Generative Retrieval that generates category paths step-by-step and decodes docid. |
| Outcome: | The proposed method provides explanations for retrieval decision by generating hierarchical category paths step-by-step and decoding docid. |
Topic Modeling: Contextual Token Embeddings Are All You Need (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current neural approaches to topic modeling have not been able to solve all of the problems. |
| Approach: | They propose a topic modeling approach that uses document contextual token embeddings to find topics and find topic spans within documents. |
| Outcome: | The proposed model outperforms the current state-of-the-art models on a comprehensive set of topic model evaluation metrics. |
Hierarchical Topic Modeling via Contrastive Learning and Hyperbolic Embedding (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing hierarchical topic models are based on Euclidean space, which cannot retain the hierarchically semantic information in the corpus, leading to irrational structure of the generated topics. |
| Approach: | They propose a novel hierarchical topic model that uses contrastive learning to capture information from documents. |
| Outcome: | The proposed model performs on topic coherence and topic diversity, and on the rationality of the topic hierarchy. |
CobwebTM: Probabilistic Concept Formation for Lifelong and Hierarchical Topic Modeling (2026.findings-acl)
Copied to clipboard
| Challenge: | Topic modeling seeks to uncover latent semantic structure in text corpora with minimal supervision. |
| Approach: | They propose a lifelong hierarchical topic model based on incremental probabilistic concept formation that constructs semantic hierarchies online without predefining the number of topics. |
| Outcome: | The proposed model achieves strong topic coherence, stable topics over time, and high-quality hierarchies without predefining the number of topics. |
Topic Taxonomy Expansion via Hierarchy-Aware Topic Phrase Generation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for topic taxonomies focus on frequent terms and local topic-subtopic relations, which leads to limited topic term coverage. |
| Approach: | They propose a framework for topic taxonomy expansion that directly generates topic-related terms belonging to new topics. |
| Outcome: | The proposed framework outperforms baseline methods on two real-world text corpora. |
Hierarchical Neural Story Generation (P18-1)
Copied to clipboard
| Challenge: | a hierarchical model that generates a premise and then conditions on it creates fluent text . a novel form of model fusion improves the relevance of the story to the prompt . |
| Approach: | They use a hierarchical model that first generates a premise, then transforms it into a text . they use fusion to improve relevance of the story to the prompt and add a gated mechanism to model context . |
| Outcome: | The proposed model improves on strong baselines on automated and human evaluations. |
Enhancing Neural Topic Model with Multi-Level Supervisions from Seed Words (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing topic seed words are difficult to incorporate into topic models due to the semantic diversity of natural language. |
| Approach: | They propose a neural topic model enhanced with supervisions from seed words on word and document levels. |
| Outcome: | The proposed model outperforms the state-of-the-art seeded topic models in terms of topic quality and classification accuracy. |