Papers by Hareesh Bahuleyan
Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generation (2022.findings-acl)
Copied to clipboard
| Challenge: | Current language generation models suffer from issues such as repetition, incoherence, and hallucinations . |
| Approach: | They propose to analyze exposure bias from an imitation learning perspective and prove it is a problem . they show that exposure bias leads to an accumulation of errors during generation . |
| Outcome: | The proposed model fails to capture errors during generation and poor generation quality. |
Polarized-VAE: Proximity Based Disentangled Representation Learning for Text Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for learning disentangled representations of real-world data focus on attribute labels or unsupervised methods that manipulate factorization in the latent space of models such as the variational autoencoder (VAE). |
| Approach: | They propose an approach that disentangles select attributes in the latent space based on proximity measures reflecting the similarity between data points with respect to these attributes. |
| Outcome: | The proposed method outperforms the VAE baseline and is competitive with state-of-the-art approaches while being more a general framework applicable to other attribute disentanglement tasks. |
Disentangled Representation Learning for Non-Parallel Text Style Transfer (P19-1)
Copied to clipboard
| Challenge: | a paper aims to disentangle latent representations of style and content in language models . auxiliary multi-task and adversarial objectives are used to disentangle the latent space . |
| Approach: | They propose a simple yet effective approach to disentangling latent representations . they propose auxiliary multi-task and adversarial objectives to disentangle style and content . |
| Outcome: | The proposed approach achieves high performance in terms of transfer accuracy, content preservation, and language fluency compared to previous approaches . |
Diverse Keyphrase Generation with Neural Unlikelihood Training (2020.coling-main)
Copied to clipboard
| Challenge: | Recent advances in neural natural language generation have made possible remarkable progress on the task of keyphrase generation, however, the importance of diversity in keyphrases has been largely ignored. |
| Approach: | They propose to train a sequence-to-sequence keyphrase generation model from the perspective of diversity. |
| Outcome: | The proposed model achieves large diversity gains while maintaining competitive output quality. |
Stochastic Wasserstein Autoencoder for Probabilistic Sentence Generation (N19-1)
Copied to clipboard
| Challenge: | Experimental results show that the latent space learned by WAE exhibits properties of continuity and smoothness as in VAEs. |
| Approach: | They propose to use the variational autoencoder (VAE) for probabilistic sentence generation . they propose a variant of WAE that encourages the stochasticity of the encoder . |
| Outcome: | The proposed variant encourages the stochasticity of the encoder while achieving higher BLEU scores. |
Variational Attention for Sequence-to-Sequence Models (C18-1)
Copied to clipboard
| Challenge: | Existing variational autoencoders encode data to latent variables and then decode them into target data. |
| Approach: | They propose a variational attention mechanism where the attention vector is also modeled as Gaussian distributed random variables. |
| Outcome: | The proposed method reduces the variational latent space bypassing phenomenon as it increases diversity of generated sentences. |