| Challenge: | Rather than finding arbitrary topics, people often want to explore the text based on some welldefined topics. |
| Approach: | They propose a problem called coordinated topic modeling that imitates human behavior while describing a text corpus. |
| Outcome: | The proposed model is superior to baseline models on multiple domains. |
Similar Papers
A Query-Driven Topic Model (2021.findings-acl)
Copied to clipboard
| Challenge: | Topic modeling is an unsupervised method for revealing the hidden semantic structure of a corpus. |
| Approach: | They propose a query-driven topic model that allows users to specify a simple query in words or phrases and return query-related topics. |
| Outcome: | The proposed model is particularly attractive when the query has a low occurrence in a text corpus, making it difficult for traditional topic models to identify relevant topics. |
Dynamic Topic Modeling by Clustering Embeddings from Pretrained Language Models: A Research Proposal (2022.aacl-srw)
Copied to clipboard
| Challenge: | Neural Topic Models (NTMs) are topic models that are created with the help of a pretrained language model. |
| Approach: | They propose to do Neural Topic Modeling by Clustering document Embeddings (NTM-CE) with a pretrained language model to create dynamic topic models. |
| Outcome: | The proposed model can be evaluated theoretically and practically using quantitative measurements of coherence and human evaluation to evaluate the model. |
A User-Centered, Interactive, Human-in-the-Loop Topic Modelling System (2023.eacl-main)
Copied to clipboard
| Challenge: | Recent research has demonstrated the value of user feedback, but there are still issues to consider, such as the difficulty in tracking changes and comparing different models. |
| Approach: | They propose a human-in-the-loop topic modeling system that integrates users’ knowledge into the modelling process, enabling them to refine the model iteratively. |
| Outcome: | The proposed system is based on a series of user studies to assess its performance in progressively more realistic applications. |
LLM-XTM: Enhancing Cross-Lingual Topic Models with Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing cross-lingual topic models depend on sparse bilingual resources and often yield incoherent or weakly aligned topics. |
| Approach: | They propose a framework that integrates LLM-guided topic refinement with self-consistency uncertainty quantification to enable black-box, stable, and scalable enhancement of cross-lingual topic models. |
| Outcome: | Experiments on multilingual corpora show that the proposed framework achieves superior topic coherence and alignment while reducing reliance on bilingual dictionaries and expensive LLM calls. |
Topic Modeling: Contextual Token Embeddings Are All You Need (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current neural approaches to topic modeling have not been able to solve all of the problems. |
| Approach: | They propose a topic modeling approach that uses document contextual token embeddings to find topics and find topic spans within documents. |
| Outcome: | The proposed model outperforms the current state-of-the-art models on a comprehensive set of topic model evaluation metrics. |
CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modeling (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing topic models rely on bag-of-words (BOW) representations to capture word order information. |
| Approach: | They propose a neural topic model that integrates contextualized word embeddings from BERT to learn the topic vector of a document without BOW information. |
| Outcome: | The proposed model generates more coherent and meaningful topics compared to existing models while accommodating unseen words in newly encountered documents. |
Pre-training and Fine-tuning Neural Topic Model: A Simple yet Effective Approach to Incorporating External Knowledge (2022.acl-long)
Copied to clipboard
| Challenge: | Recent studies have shown that using external knowledge such as pre-trained word embeddings or pre-train language models only achieved limited performance improvements but with huge computational overhead. |
| Approach: | They propose to incorporate external knowledge into neural topic modeling by pre-trained word embeddings (PWEs) or pre-train language models (PLMs) they propose to fine-tune the neural topic model on the target dataset and reduce the huge size of training data. |
| Outcome: | The proposed approach outperforms current state-of-the-art neural topic models and some topic modeling approaches enhanced with PWEs or PLMs on three datasets and greatly reduces the huge size of training data. |
Modeling Online Discourse with Coupled Distributed Topics (D18-1)
Copied to clipboard
| Challenge: | a topic model that incorporates structural relationships connecting documents in socially generated corpora is of limited application in the sciences. |
| Approach: | They propose a topic model that incorporates structural relationships connecting documents in socially generated corpora, such as online forums. |
| Outcome: | The proposed model captures discursive interactions along observed reply links and integrates latent distributed representations in a deep architecture. |
Multi-source Neural Topic Modeling in Multi-view Embedding Spaces (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent work has used pre-trained word embeddings to address data sparsity in short-text or small document collections. |
| Approach: | They propose a neural topic modeling framework using multi-view embedding spaces to improve topic quality and deal with polysemy. |
| Outcome: | The proposed framework improves topic quality and deal with polysemy. |
XTRA: Cross-Lingual Topic Modeling with Topic and Representation Alignments (2025.findings-emnlp)
Copied to clipboard
| Challenge: | XTRA aims to uncover shared semantic themes across languages . previous methods have achieved improvements in topic diversity but struggle to ensure high topic coherence and consistent alignment across languages. |
| Approach: | a new framework unifies Bag-of-Words modeling with multilingual embeddings is proposed to address this problem . XTRA introduces two core components: (1) representation alignment and (2) topic alignment to enforce cross-lingual consistency. |
| Outcome: | XTRA outperforms baselines in topic coherence, diversity, and alignment quality on multilingual corpora. |