Unsupervised Few-Bits Semantic Hashing with Implicit Topics Modeling (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for few-bits hashing cannot be guaranteed due to severe information loss. |
| Approach: | They propose a simple unsupervised neural generative semantic hashing method with a focus on few-bits hash. |
| Outcome: | The proposed method improves on the state-of-the-art methods in few-bits hashing. |
Similar Papers
Generative Semantic Hashing Enhanced via Boltzmann Machines (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for generative semantic hashing assume a factorized posterior distribution, enforcing independence among the bits of hash codes. |
| Approach: | They propose to use a Boltzmann machine distribution as the variational posterior to introduce correlations among the bits of hash codes. |
| Outcome: | The proposed method can achieve significant performance gains by combining two hash codes. |
NASH: Toward End-to-End Neural Architecture for Generative Semantic Hashing (P18-1)
Copied to clipboard
Dinghan Shen, Qinliang Su, Paidamoyo Chapfuwa, Wenlin Wang, Guoyin Wang, Ricardo Henao, Lawrence Carin
| Challenge: | Existing approaches to fast similarity search require two-stage training and the binary constraints are handled ad-hoc. |
| Approach: | They propose an end-to-end neural architecture for semantic hashing where binary hash codes are treated as Bernoulli latent variables. |
| Outcome: | The proposed approach outperforms state-of-the-art models on unsupervised and supervised scenarios on three public datasets. |
Neural Topic Modeling via Contextual and Graph Information Fusion (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing topic models generate uninformative and incoherent topics that hinder interpretable insights from managing textual data. |
| Approach: | They propose to incorporate contextual and graph information to improve the variational autoencoder framework by combining contextual and bag-of-words information. |
| Outcome: | The proposed framework generates more coherent and diverse topics on three benchmark datasets and achieves strong performance on automatic and manual evaluations. |
Document Hashing with Multi-Grained Prototype-Induced Hierarchical Generative Model (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing document hashing methods only consider flat semantics of documents, preserving hierarchical semantics. |
| Approach: | They propose a hierarchical generative model that can model and leverage hierarchic semantics . they introduce hierarchically-based prototypes into the model to construct a Hierarchical prior distribution . |
| Outcome: | The proposed model outperforms baseline methods on hierarchical and flat datasets. |
Enhancing Short-Text Topic Modeling with LLM-Driven Context Expansion and Prefix-Tuned VAEs (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing topic models often lack sufficient word co-occurrence in short texts, resulting in incoherent topics. |
| Approach: | They propose to use large language models to extend short texts into more detailed sequences before applying topic modeling to solve semantic inconsistency problem. |
| Outcome: | The proposed approach significantly outperforms current state-of-the-art topic models on real-world datasets with extreme data sparsity. |
Topic-Aware Neural Keyphrase Generation for Social Media Language (P19-1)
Copied to clipboard
| Challenge: | Existing methods to extract words from source posts to form keyphrases do not exploit latent topics. |
| Approach: | They propose a sequence-to-sequence-based neural keyphrase generation framework . it allows absent keyphrases to be created, and it allows joint modeling of latent topic representations . |
| Outcome: | The proposed model outperforms extraction and generation models without exploiting latent topics. |
A Neural Generative Model for Joint Learning Topics and Topic-Specific Word Embeddings (2020.tacl-1)
Copied to clipboard
| Challenge: | Experimental results show that the proposed model outperforms word-level embedding methods in word similarity evaluation and word sense disambiguation. |
| Approach: | They propose a generative model that explores local and global context for joint learning topics and topic-specific word embeddings. |
| Outcome: | The proposed model outperforms word-level embedding methods in word similarity evaluation and word sense disambiguation. |
Towards Reinterpreting Neural Topic Models via Composite Activations (2022.emnlp-main)
Copied to clipboard
| Challenge: | Most Neural Topic Models (NTMs) use a variational auto-encoder framework producing K topics limited to the size of the encoder’s output. |
| Approach: | They propose a model-free two-stage process to reinterpret NTM and derive further insights on the state of the trained model. |
| Outcome: | The proposed model-free process decouples the strict interpretation of topics from the original NTM and evaluates them on a large external corpus. |
Short Text Topic Modeling with Topic Distribution Quantization and Negative Sampling Decoder (2020.emnlp-main)
Copied to clipboard
| Challenge: | Topic models for short texts suffer from data sparsity because of limited word co-occurrences. |
| Approach: | They propose a neural topic model with a new topic distribution quantization approach that generates peakier distributions that are more appropriate for modeling short texts. |
| Outcome: | The proposed model outperforms both strong traditional and neural baselines under extreme data sparsity scenes, producing high-quality topics. |
Bridging Pre-trained Language Models and Hand-crafted Features for Unsupervised POS Tagging (2022.findings-acl)
Copied to clipboard
| Challenge: | Large-scale pre-trained language models (PLMs) have made extraordinary progress in most NLP tasks, but they fail to achieve state-of-the-art (SOTA) performance. |
| Approach: | They propose a Guassian HMM variant for unsupervised POS tagging that incorporates contexualized word representations into the decoder. |
| Outcome: | The proposed model outperforms state-of-the-art models on Penn Treebank and multilingual Universal Dependencies treebank v2.0. |