Formality Style Transfer for Noisy, User-generated Conversations: Extracting Labeled, Parallel Data from Unlabeled Corpora (D19-55)
Copied to clipboard
| Challenge: | Typical datasets used for style transfer in NLP contain aligned pairs of two opposite extremes of a style. |
| Approach: | They propose a technique to derive a dataset of aligned pairs from an unlabeled corpus by using an auxiliary dataset, allowing for in-domain training. |
| Outcome: | The proposed method significantly outperforms OpenNMT’s Seq2Seq model trained on the Yahoo Formality Dataset and 6 novel datasets. |
Similar Papers
Parallel Data Augmentation for Formality Style Transfer (2020.acl-main)
Copied to clipboard
| Challenge: | Formality style transfer is a task of automatically transforming text in one particular formality style into another. |
| Approach: | They propose to augment parallel data with three specific data augmentation methods to improve the model's generalization ability and reduce the overfitting risk. |
| Outcome: | The proposed methods significantly improve performance when used to pre-train the model and lead to the state-of-the-art results in the GYAFC benchmark dataset. |
Dear Sir or Madam, May I Introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfer (N18-1)
Copied to clipboard
| Challenge: | a lack of training and evaluation datasets, benchmarks and automatic metrics has blocked progress in this field. |
| Approach: | They propose to use a grammarly's Yahoo Answers Formality corpus to create the largest corpus for a particular style . they also propose to apply machine translation metrics to the task . |
| Outcome: | The proposed model can be used to train and evaluate a text in a particular style . the proposed model is based on the existing model and can be applied to other tasks . |
Disentangled Representation Learning for Non-Parallel Text Style Transfer (P19-1)
Copied to clipboard
| Challenge: | a paper aims to disentangle latent representations of style and content in language models . auxiliary multi-task and adversarial objectives are used to disentangle the latent space . |
| Approach: | They propose a simple yet effective approach to disentangling latent representations . they propose auxiliary multi-task and adversarial objectives to disentangle style and content . |
| Outcome: | The proposed approach achieves high performance in terms of transfer accuracy, content preservation, and language fluency compared to previous approaches . |
Harnessing Pre-Trained Neural Networks with Rules for Formality Style Transfer (D19-1)
Copied to clipboard
| Challenge: | Existing studies normalize informal sentences with rules, but they introduce noise if we use them in a naive way. |
| Approach: | They propose to harness rules into a state-of-the-art neural network that is typically pretrained on massive corpora. |
| Outcome: | The proposed method can be used to generate a state-of-the-art on a small dataset. |
Towards Robust and Semantically Organised Latent Representations for Unsupervised Text Style Transfer (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent studies show that auto-encoders perform language generation, smooth sentence interpolation, and style transfer over unseen attributes using unlabelled datasets in a zero-shot manner. |
| Approach: | They propose a discrete token-based perturbation approach to map "similar" sentences close by in latent space. |
| Outcome: | The proposed model can generate and perform language generation, style transfer and sentence interpolation tasks on unlabelled datasets in a zero-shot manner. |
Formality Style Transfer with Shared Latent Space (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches for formality style transfer use neural networks for sentence generation, but the dataset for formal style transfer is considerably smaller than translation corpora. |
| Approach: | They propose a new approach for formality style transfer using shared latent space and two auxiliary losses. |
| Outcome: | The proposed approach outperforms baselines in various settings, especially when limited data is available. |
Reformulating Unsupervised Style Transfer as Paraphrase Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing systems for style transfer warp the input’s meaning through attribute transfer, which changes semantic properties such as sentiment. |
| Approach: | They propose a method for fine-tuning pretrained language models on automatically generated paraphrase data to improve the efficiency of style transfer. |
| Outcome: | The proposed method outperforms state-of-the-art style transfer systems on human and automatic evaluations and proposes fixed variants. |
Generic resources are what you need: Style transfer tasks without task-specific parallel training data (2021.emnlp-main)
Copied to clipboard
| Challenge: | Text style transfer is a task aimed at converting a text of one style into another while preserving its content. |
| Approach: | They propose a multi-step procedure which builds on a generic pre-trained sequence-to-sequence model and an iterative back-translation approach to train two models in a transfer direction. |
| Outcome: | The proposed method outperforms existing unsupervised approaches on the two most popular style transfer tasks: formality transfer and polarity swap. |
Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Formality style transfer is the task of converting informal sentences to grammatically-correct formal sentences. |
| Approach: | They propose a semi-supervised formality style transfer model that utilizes a language model-based discriminator to maximize the likelihood of the output sentence being formal. |
| Outcome: | The proposed model outperforms state-of-the-art models in terms of automated metrics and human judgement. |
StyleFlow: Disentangle Latent Representations via Normalizing Flow for Unsupervised Text Style Transfer (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to separate content from style but some words contain both content and style information. |
| Approach: | They propose a method which uses a reversible encoder to improve content disentanglement. |
| Outcome: | The proposed method outperforms baselines on sentiment transfer and formality transfer tasks. |