| Challenge: | Existing topic models adopt a fully unsupervised setting and their discovered topics may not reflect user preferences well due to their unsupervised nature. |
| Approach: | They propose a framework that allows out-of-vocabulary seeds to be used to find latent topics from text corpora. |
| Outcome: | The proposed framework can find topics that are never seen in the corpus and can benefit from the general knowledge of pre-trained language models. |
Similar Papers
UCTopic: Unsupervised Contrastive Learning for Phrase Representations and Topic Mining (2022.acl-long)
Copied to clipboard
| Challenge: | Existing phrase representation learning methods combine unigram representations in a context-free manner or rely on extensive annotations to learn context-aware knowledge. |
| Approach: | They propose a novel unsupervised contrastive learning framework for context-aware phrase representations and topic mining. |
| Outcome: | The proposed framework outperforms the state-of-the-art phrase representation model by 38.2% NMI on four entity clustering tasks. |
LLM-Guided Semantic-Aware Clustering for Topic Modeling (2025.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that topic modeling is competitive compared to closed-source methods. |
| Approach: | They propose a semi-supervised topic modeling method that combines LLMs with clustering to improve topic generation and distribution. |
| Outcome: | The proposed method outperforms state-of-the-art methods that utilize GPT-4 on topic alignment and exhibits competitive performance compared to Neural Topic Models on topic quality. |
Seeded Hierarchical Clustering for Expert-Crafted Taxonomies (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Practitioners from many disciplines use expert-crafted taxonomies to make sense of large, unlabeled corpora. |
| Approach: | They propose a weakly supervised algorithm for seeded hierarchical clustering that fits unlabeled data to taxonomies using a small set of labeled examples. |
| Outcome: | The proposed algorithm outperforms baselines on three real-world datasets. |
Explicit Bayesian Inference to Uncover the Latent Themes of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive generative capabilities, yet their inner mechanisms remain largely opaque. |
| Approach: | They propose a variational autoencoder-based neural topic model to interpret LLMs generation process through an explicit Bayesian framework by inferring latent topic variables via variational inference. |
| Outcome: | The proposed model outperforms state-of-the-art topic models on intrinsic measures of coherence and diversity on multiple datasets and shows significant gains on classification and summarization tasks. |
A Generic Method for Fine-grained Category Discovery in Natural Language Texts (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fine-grained category discovery neglect semantic similarities of fine-grain categories. |
| Approach: | They propose a method that detects fine-grained clusters of semantically similar texts guided by a novel objective function. |
| Outcome: | The proposed method surpasses state-of-the-art methods on three benchmark tasks. |
TopicGPT: A Prompt-based Topic Modeling Framework (2024.naacl-long)
Copied to clipboard
| Challenge: | TopicGPT uses large language models to uncover latent topics in text . topic models represent topics as bags of words that require "reading the tea leaves" topic models also offer limited control over formatting and specificity of topics . |
| Approach: | TopicGPT uses large language models to uncover latent topics in text . authors propose a prompt-based framework that produces topics that align better with human categorizations . |
| Outcome: | TopicGPT produces topics that align better with human categorizations compared to competing methods. |
Enhancing Neural Topic Model with Multi-Level Supervisions from Seed Words (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing topic seed words are difficult to incorporate into topic models due to the semantic diversity of natural language. |
| Approach: | They propose a neural topic model enhanced with supervisions from seed words on word and document levels. |
| Outcome: | The proposed model outperforms the state-of-the-art seeded topic models in terms of topic quality and classification accuracy. |
Unified Neural Topic Model via Contrastive Learning and Term Weighting (2023.eacl-main)
Copied to clipboard
| Challenge: | Recent techniques employ pretrained language models to improve topic quality. |
| Approach: | They propose a topic-based model that uses contrastive learning and term weighting to learn from a pretrained language model and discover influential terms from semantically coherent clusters. |
| Outcome: | The proposed model outperforms baselines across multiple topic coherence measures and can be used as an add-on to existing topic models and improves their performance. |
Topic Sensitive Attention on Generic Corpora Corrects Sense Bias in Pretrained Embeddings (P19-1)
Copied to clipboard
| Challenge: | Existing methods to adapt pretrained embeddings to a large corpus are limited and do not provide sufficient quality. |
| Approach: | They propose to use a small corpus D_T to pretrain embeddings that accurately capture the sense of words in a limited set of focused topics. |
| Outcome: | The proposed embeddings capture the sense of words in a topic in spite of the limited size of the corpus D_T. |
GINopic: Topic Modeling with Graph Isomorphism Network (2024.naacl-long)
Copied to clipboard
| Challenge: | Recent studies focus on the representation of documents as a sequence of words, but word dependency patterns are not captured in topic modeling. |
| Approach: | They propose a topic modeling framework based on graph isomorphism networks to capture word dependencies between words. |
| Outcome: | The proposed framework is compared with existing topic models on a dataset of a large text collection and shows that it can uncover the underlying topics in an unsupervised manner. |