| Challenge: | Large Language Models (LLMs) have demonstrated promising capabilities in topic discovery, but their direct application to topic modeling suffers from issues such as incomplete topic coverage, misalignment of topics, and inefficiency. |
| Approach: | They propose a novel LLM-in-the-loop framework that integrates Large Language Models with Neural Topic Models (NTMs) global topics and document representations are learned through the NTM, while an LLM refines these topics using an Optimal Transport (OT)-based alignment objective. |
| Outcome: | The proposed framework improves topic interpretability while preserving the efficiency of existing NTMs. |
Similar Papers
Topic Modeling for Short Texts with Large Language Models (2024.acl-srw)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can be used to solve topic modeling challenges for short texts by contextually learning the meanings of words. |
| Approach: | They propose two approaches to using Large Language Models (LLMs) for topic modeling: parallel prompting and sequential prompting. |
| Outcome: | The proposed methods identify more coherent topics than existing ones while maintaining the diversity of the induced topics. |
LLM-Guided Semantic-Aware Clustering for Topic Modeling (2025.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that topic modeling is competitive compared to closed-source methods. |
| Approach: | They propose a semi-supervised topic modeling method that combines LLMs with clustering to improve topic generation and distribution. |
| Outcome: | The proposed method outperforms state-of-the-art methods that utilize GPT-4 on topic alignment and exhibits competitive performance compared to Neural Topic Models on topic quality. |
Revisiting Automated Topic Model Evaluation with Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Topic models are an unsupervised dimensionality reduction technique that help organize large text collections. |
| Approach: | They propose to use large language models to evaluate document output and determine optimal number of topics. |
| Outcome: | The proposed model performs better on coherence ratings of word sets than on intrustion detection. |
LLM-XTM: Enhancing Cross-Lingual Topic Models with Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing cross-lingual topic models depend on sparse bilingual resources and often yield incoherent or weakly aligned topics. |
| Approach: | They propose a framework that integrates LLM-guided topic refinement with self-consistency uncertainty quantification to enable black-box, stable, and scalable enhancement of cross-lingual topic models. |
| Outcome: | Experiments on multilingual corpora show that the proposed framework achieves superior topic coherence and alignment while reducing reliance on bilingual dictionaries and expensive LLM calls. |
Large Language Models Offer an Alternative to the Traditional Approach of Topic Modelling (2024.lrec-main)
Copied to clipboard
| Challenge: | Topic modelling has found extensive use in automatically detecting significant topics within a corpus of documents, but there are certain drawbacks. |
| Approach: | They propose a framework that prompts large language models to generate topics from a given set of documents and establish evaluation protocols to assess the clustering efficacy of LLMs. |
| Outcome: | The proposed model generates relevant topic titles and adheres to human guidelines to refine and merge topics. |
DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLM (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Neural Topic Models and Large Language Models (LLMs) primarily use contextual embeddings from LLMs, which are not optimal for clustering or topic generation. |
| Approach: | They propose a framework that leverages Encoder-Decoders to generate highly clusterable embeddings that could generate topics that exhibit enhanced clusterability and enhanced semantic coherence compared to existing methods. |
| Outcome: | The proposed framework is efficient to train and exhibits high adaptability, demonstrating its potential for a wide array of applications. |
Enhancing Short-Text Topic Modeling with LLM-Driven Context Expansion and Prefix-Tuned VAEs (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing topic models often lack sufficient word co-occurrence in short texts, resulting in incoherent topics. |
| Approach: | They propose to use large language models to extend short texts into more detailed sequences before applying topic modeling to solve semantic inconsistency problem. |
| Outcome: | The proposed approach significantly outperforms current state-of-the-art topic models on real-world datasets with extreme data sparsity. |
Large Language Models for Generative Recommendation: A Survey and Visionary Discussions (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized the field of natural language processing but are not fully able to leverage the generative power of LLM. |
| Approach: | They examine the progress, methods, and future directions of large language models . they examine what generative recommendation is, why RS should advance to generative recommendations . |
| Outcome: | The proposed approach can be simplified to generate recommendations from the entire pool of items. |
Large Language Models Struggle to Describe the Haystack without Human Help: A Social Science-Inspired Evaluation of Topic Models (2025.acl-long)
Copied to clipboard
Zongxia Li, Lorena Calvo-Bartolomé, Alexander Miserlis Hoyle, Paiheng Xu, Daniel Kofi Stephens, Juan Francisco Fung, Alden Dima, Jordan Lee Boyd-Graber
| Challenge: | a common use of NLP is to facilitate the understanding of large document collections. |
| Approach: | They propose to use large language models to replace probabilistic topic models in real-world applications. |
| Outcome: | The proposed model generates more human-readable topics and shows higher average win probabilities than traditional models for data exploration. |
HiCOT: Improving Neural Topic Models via Optimal Transport and Contrastive Learning (2025.findings-acl)
Copied to clipboard
| Challenge: | Recent advances in neural topic models (NTMs) have improved topic quality but still face challenges: weak document-topic alignment, high inference costs due to large pretrained language models, and limited modeling of hierarchical topic structures. |
| Approach: | They propose a framework that integrates hierarchical clustering and contrastive learning to refine document-topic relationships using compact PLM-based embeddings. |
| Outcome: | The proposed framework improves topic coherence, topic performance, representation quality and computational efficiency over existing NTMs. |