Variational Autoencoder with Embedded Student-t Mixture Model for Authorship Attribution (2020.coling-main)
Copied to clipboard
| Challenge: | Existing Variational autoencoders are limited by the assumed Gaussianity of the underlying probability distributions in the latent space. |
| Approach: | They propose a probabilistic autoencoding framework to deal with a supervised authorship attribution task. |
| Outcome: | The proposed method outperforms existing methods on an Amazon review dataset. |
Similar Papers
Explainable Disentangled Representation Learning for Generalizable Authorship Attribution in the Era of Generative AI (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods struggle with content-style entanglement, leading to poor generalization across domains. |
| Approach: | They propose an explanation-by-design framework that explicitly disentangles style from content through architectural separation-by design. |
| Outcome: | The proposed framework disentangles style from content through architectural separation-by-design. |
RegaVAE: A Retrieval-Augmented Gaussian Mixture Variational Auto-Encoder for Language Modeling (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing research on retrieval-augmented language models has two main problems: determining what information to retrieve and effectively combining retrieved information during generation. |
| Approach: | They propose a retrieval-augmented language model that captures current and future information from source and target text into a latent space. |
| Outcome: | The proposed model is more efficient than explicit raw text, but limited by context length and noise. |
Topic-Guided Variational Auto-Encoder for Text Generation (N19-1)
Copied to clipboard
Wenlin Wang, Zhe Gan, Hongteng Xu, Ruiyi Zhang, Guoyin Wang, Dinghan Shen, Changyou Chen, Lawrence Carin
| Challenge: | Experimental results show that our model outperforms its competitors on both unconditional and conditional text generation. |
| Approach: | They propose a topic-guided variational auto-encoder model for text generation that specifies a Gaussian mixture model and a neural topic module to generate sentences under the topic. |
| Outcome: | The proposed model outperforms existing variational auto-encoders on unconditional and conditional text generation, and can generate semantically-meaningful sentences with various topics. |
Spherical Latent Spaces for Stable Variational Autoencoders (D18-1)
Copied to clipboard
| Challenge: | Variational autoencoders use a multivariate Gaussian latent variable to capture latent structure in data. |
| Approach: | They propose a variational autoencoder which uses a latent distribution instead of Gaussian . they find that the variational posterior averts the KL collapse by a fixed hyperparameter . |
| Outcome: | The von Mises-Fisher distribution averts the KL collapse and gives better likelihoods than Gaussian models across a range of modeling conditions. |
Stochastic Wasserstein Autoencoder for Probabilistic Sentence Generation (N19-1)
Copied to clipboard
| Challenge: | Experimental results show that the latent space learned by WAE exhibits properties of continuity and smoothness as in VAEs. |
| Approach: | They propose to use the variational autoencoder (VAE) for probabilistic sentence generation . they propose a variant of WAE that encourages the stochasticity of the encoder . |
| Outcome: | The proposed variant encourages the stochasticity of the encoder while achieving higher BLEU scores. |
A Surprisingly Effective Fix for Deep Latent Variable Modeling of Text (D19-1)
Copied to clipboard
| Challenge: | Variational Autoencoders are powerful language models and effective representation learning frameworks. |
| Approach: | They propose a fix for posterior collapse which improves held-out likelihood, reconstruction and latent representation learning . |
| Outcome: | The proposed fix significantly improves held-out likelihood, reconstruction, and latent representation learning compared with previous state-of-the-art methods. |
FlowPrior: Learning Expressive Priors for Latent Variable Sentence Models (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing training strategies are not effective for learning rich priors, we propose adding the importance-sampled log marginal likelihood as a second term to the standard VAE objective. |
| Approach: | They propose to add importance-sampled log marginal likelihood to standard VAE objective to help when learning the prior. |
| Outcome: | The proposed model improves language modeling tasks compared to baselines. |
Layered Insights: Generalizable Analysis of Human Authorial Style by Leveraging All Transformer Layers (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to authorship attribution model only learn from the output layer of pre-trained transformers, ignoring representations learned at other layers. |
| Approach: | They propose a model that leverages the various linguistic representations learned at different layers of pre-trained transformer-based models to model the authorship attribution task more effectively. |
| Outcome: | The proposed model performs better on out-of-domain and in-domain scenarios, while ignoring representations learned at other layers. |
Topic-Regularized Authorship Representation Learning (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing techniques for authorship attribution have focused on out-of-distribution in topics or authors. |
| Approach: | They propose a framework that creates authorship representation with reduced reliance on topic-specific information to handle a large number of unseen authors and topics. |
| Outcome: | The proposed framework has improved over baselines in 4 out of 6 cases. |
Empirical Prior for Text Autoencoders (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Variational Autoencoders (VAE) are used to train generative models with latent variables. |
| Approach: | They propose a transition from Variational Autoencoders (VAE) to text autoencodeurs (AE) which model a compact latent space and preserves the capability of the language model itself. |
| Outcome: | The proposed method generates higher quality and more diverse text than the VAE-based Transformer baselines, and is more efficient than previous approaches. |