Papers by Leif Jonsson
Sparse Parallel Training of Hierarchical Dirichlet Process Topic Models (2020.emnlp-main)
Copied to clipboard
| Challenge: | To scale non-parametric extensions of probabilistic topic models, practitioners rely increasingly on parallel and distributed systems. |
| Approach: | They propose a data-parallel sampler that utilizes all available sources of sparsity found in natural language to control memory requirements and computational complexity. |
| Outcome: | The proposed sampler is able to train a hierarchical Dirichlet process topic model on a well-known corpus (PubMed) with 8m documents and 768m tokens, using a single multi-core machine in under four days. |