Learning Disentangled Representations of Negation and Uncertainty (2022.acl-long)
Copied to clipboard
| Challenge: | Negation and uncertainty modeling are long-standing tasks in natural language processing. |
| Approach: | They propose to disentangle negation, uncertainty, and content using a Variational Autoencoder by supervising latent representations using auxiliary objectives. |
| Outcome: | The proposed model can disentangle negation, uncertainty, and content using a Variational Autoencoder. |
Similar Papers
Polarized-VAE: Proximity Based Disentangled Representation Learning for Text Generation (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for learning disentangled representations of real-world data focus on attribute labels or unsupervised methods that manipulate factorization in the latent space of models such as the variational autoencoder (VAE). |
| Approach: | They propose an approach that disentangles select attributes in the latent space based on proximity measures reflecting the similarity between data points with respect to these attributes. |
| Outcome: | The proposed method outperforms the VAE baseline and is competitive with state-of-the-art approaches while being more a general framework applicable to other attribute disentanglement tasks. |
Learning Disentangled Representations for Natural Language Definitions (2023.findings-eacl)
Copied to clipboard
| Challenge: | Disentangling the encodings of neural models is a fundamental aspect for improving interpretability, semantic control and downstream task performance in Natural Language Processing. |
| Approach: | They propose to use syntactic and semantic regularities in textual data to provide models with both structural biases and generative factors. |
| Outcome: | The proposed model outperforms baselines on several qualitative and quantitative benchmarks and improves the results in the downstream task of definition modeling. |
Disentangling Generative Factors in Natural Language with Discrete Variational Autoencoders (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Disentangled representation learning aims to provide an interpretable representation of latent features and a framework for controlling the change of specific features. |
| Approach: | They propose a Variational Autoencoder based method which models language features as discrete variables and encourages independence between variables for learning disentangled representations. |
| Outcome: | The proposed model outperforms baselines on several qualitative and quantitative benchmarks and on a text style transfer downstream application. |
An Evaluation of Disentangled Representation Learning for Texts (2021.findings-acl)
Copied to clipboard
| Challenge: | Disentangled representations of texts encode information pertaining to different aspects of the text in separate vector embeddings. |
| Approach: | They propose to use a highly-structured natural language dataset to evaluate disentangled representations for texts. |
| Outcome: | The proposed models are well-suited for learning disentangled representations of texts on a synthetic natural language dataset. |
Disentangled Representation Learning for Non-Parallel Text Style Transfer (P19-1)
Copied to clipboard
| Challenge: | a paper aims to disentangle latent representations of style and content in language models . auxiliary multi-task and adversarial objectives are used to disentangle the latent space . |
| Approach: | They propose a simple yet effective approach to disentangling latent representations . they propose auxiliary multi-task and adversarial objectives to disentangle style and content . |
| Outcome: | The proposed approach achieves high performance in terms of transfer accuracy, content preservation, and language fluency compared to previous approaches . |
A Novel Estimator of Mutual Information for Learning to Disentangle Textual Representations (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for learning disentangled representations of textual data are difficult to implement and suffer from the degeneracy of other losses in multi-class scenarios. |
| Approach: | They propose a variational upper bound to the mutual information between an attribute and the latent code of an encoder that controls the approximation error. |
| Outcome: | The proposed method is superior on fair classification and on textual style transfer tasks. |
Making Language Models Robust Against Negation (2025.naacl-long)
Copied to clipboard
| Challenge: | Negation is a semantic phenomenon that alters an expression to convey the opposite meaning. |
| Approach: | They propose a self-supervised method to make language models more robust against negation by pre-training models. |
| Outcome: | The proposed task outperforms the off-the-shelf versions on nine negation-related benchmarks. |
Explaining Word Embeddings via Disentangled Representation (2020.aacl-main)
Copied to clipboard
| Challenge: | Disentangled representations are known to represent interpretable factors in separated dimensions. |
| Approach: | They propose to transform dense word vectors into disentangled embeddings with improved interpretability by encoding polysemous semantics separately. |
| Outcome: | The proposed model can be encoded into multiple sub-embeddings or sub-areas and generates more efficient and effective features for natural language processing. |
Variational Autoencoder with Disentanglement Priors for Low-Resource Task-Specific Natural Language Generation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for task-specific natural language generation do not contain any labeled examples. |
| Approach: | They propose a variational autoencoder with disentanglement priors for task-specific natural language generation with none or a handful of task-related labeled examples. |
| Outcome: | The proposed model outperforms baseline models in terms of data augmentation and text style transfer in the few-shot setting. |
Disentangled Sequence to Sequence Learning for Compositional Generalization (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models struggle to generalize to unseen compositions of seen components . a new approach allows for disentangled representations and better generalization . |
| Approach: | They propose an extension to sequence-to-sequence models which encourage disentanglement by re-encoding source input. |
| Outcome: | The proposed extension delivers better generalization and more disentangled representations . human expressions can be understood by combining known atomic components . |