| Challenge: | Existing approaches to relevance classification are limited by annotated data and lack of relevance for each topic. |
| Approach: | They propose a cross-topic relevance embedding aggregation methodology that can expand the range of training data and apply what has been learned from source topics to a target topic. |
| Outcome: | The proposed method can capture common features within small amount of annotated data and improve performance compared with baselines. |
Similar Papers
Cross-referencing Using Fine-grained Topic Modeling (N19-1)
Copied to clipboard
| Challenge: | Cross-referencing is a useful study aid for facilitating comprehension of a text, but it requires extensive thematic knowledge and a focused search through the corpus to find such useful connections. |
| Approach: | They propose a system for producing candidate cross-references which can be easily verified by human annotators. |
| Outcome: | a new system can produce cross-references that can be easily verified by human annotators . the system uses fine-grained topic modeling to identify verse pairs which are topically related . |
XTRA: Cross-Lingual Topic Modeling with Topic and Representation Alignments (2025.findings-emnlp)
Copied to clipboard
| Challenge: | XTRA aims to uncover shared semantic themes across languages . previous methods have achieved improvements in topic diversity but struggle to ensure high topic coherence and consistent alignment across languages. |
| Approach: | a new framework unifies Bag-of-Words modeling with multilingual embeddings is proposed to address this problem . XTRA introduces two core components: (1) representation alignment and (2) topic alignment to enforce cross-lingual consistency. |
| Outcome: | XTRA outperforms baselines in topic coherence, diversity, and alignment quality on multilingual corpora. |
Topic Modeling: Contextual Token Embeddings Are All You Need (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Current neural approaches to topic modeling have not been able to solve all of the problems. |
| Approach: | They propose a topic modeling approach that uses document contextual token embeddings to find topics and find topic spans within documents. |
| Outcome: | The proposed model outperforms the current state-of-the-art models on a comprehensive set of topic model evaluation metrics. |
Is Neural Topic Modelling Better than Clustering? An Empirical Study on Clustering with Contextual Embeddings for Topics (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent work incorporates pre-trained word embeddings into Neural Topic Models (NTMs), generating highly coherent topics. |
| Approach: | They conduct thorough experiments to investigate whether embeddings directly with an appropriate word selection method can generate more coherent and diverse topics than NTMs. |
| Outcome: | The proposed model generates more coherent and diverse topics than traditional NTMs, achieving higher efficiency and simplicity. |
Adaptive Semi-supervised Learning for Cross-domain Sentiment Classification (D18-1)
Copied to clipboard
| Challenge: | Existing methods for cross-domain sentiment classification are difficult and costly . domain adaptation is difficult because data in source and target domains are drawn from different distributions. |
| Approach: | They propose a semi-supervised learning approach that minimizes the distance between source and target instances in embedded feature space. |
| Outcome: | The proposed approach can improve on baseline methods in various settings. |
Multi-source Neural Topic Modeling in Multi-view Embedding Spaces (2021.naacl-main)
Copied to clipboard
| Challenge: | Recent work has used pre-trained word embeddings to address data sparsity in short-text or small document collections. |
| Approach: | They propose a neural topic modeling framework using multi-view embedding spaces to improve topic quality and deal with polysemy. |
| Outcome: | The proposed framework improves topic quality and deal with polysemy. |
Tired of Topic Models? Clusters of Pretrained Word Embeddings Make for Fast and Good Topics too! (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing topic models rely on probabilistic models to uncover themes within document collections, but are they the only option? |
| Approach: | They propose a way to cluster pre-trained word embeddings while incorporating document information for weighted clustering and reranking top words. |
| Outcome: | The proposed approach performs as well as classical topic models, but with lower runtime and computational complexity. |
Mitigating Data Sparsity for Short Text Topic Modeling by Topic-Semantic Contrastive Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing topic models do not make full use of word co-occurrence information to model latent topics. |
| Approach: | They propose a novel short text topic modeling framework, Topic-Semantic Contrastive Topic Model, which uses augmented data and the data characteristic to learn the relations among samples. |
| Outcome: | The proposed framework outperforms state-of-the-art baselines regardless of the data augmentation availability, producing high-quality topics and topic distributions. |
CAST: Corpus-Aware Self-similarity Enhanced Topic modelling (2025.naacl-long)
Copied to clipboard
Yanan Ma, Chenghao Xiao, Chenhan Yuan, Sabine N Van Der Veer, Lamiece Hassan, Chenghua Lin, Goran Nenadic
| Challenge: | Existing topic modelling methods encode contextual information of documents while ignoring contextual details of candidate centroid words. Existing methods are limited by the contextualization gap. |
| Approach: | They propose a topic modelling method that builds upon candidate centroid word embeddings contextualized on the dataset and a self-similarity-based method to filter out less meaningful tokens. |
| Outcome: | The proposed method significantly enhances the coherence and diversity of generated topics, and handles noisy data, outperforming strong baselines. |
Extracting Topics with Simultaneous Word Co-occurrence and Semantic Correlation Graphs: Neural Topic Modeling for Short Texts (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Empirical results validate that DWGTM can generate more semantically coherent topics than baseline topic models. |
| Approach: | They develop a neural topic model which extracts topics from word co-occurrence graphs . Empirical results validate that DWGTM can generate more semantically coherent topics than baseline topic models. |
| Outcome: | Empirical results show that the proposed model can generate more coherent topics than baseline topic models. |