Papers by Jan Kostkan
S3 - Semantic Signal Separation (2025.acl-long)
Copied to clipboard
Márton Kardos, Jan Kostkan, Kenneth Enevoldsen, Arnault-Quentin Vermillet, Kristoffer Nielbo, Roberta Rocca
| Challenge: | Recent efforts to incorporate contextual representations into topic models have been shown to outperform classical topic models. |
| Approach: | They propose a theory-driven topic modeling approach that decomposes contextualized document embeddings into a Python package that implements S3 and all contextual baselines. |
| Outcome: | The proposed model is 4.5x faster than the BERTopic model and provides diverse and highly coherent topics with no preprocessing. |