Rethinking Style Transformer with Energy-based Interpretation: Adversarial Unsupervised Style Transfer using a Pretrained Model (2022.emnlp-main)
Copied to clipboard
Hojun Cho, Dohee Kim, Seungwoo Ryu, ChaeHun Park, Hyungjong Noh, Jeong-in Hwang, Minseok Choi, Edward Choi, Jaegul Choo
| Challenge: | Existing methods to train text style transfer models with adversarial loss degrade fluency compared to other metrics. |
| Approach: | They propose a method which leverages a pretrained language model to improve fluency by restructuring the discriminator and the model itself. |
| Outcome: | The proposed model achieves state-of-the-art on three public benchmarks and achieved state-outperformance on the overall metrics. |
Similar Papers
Text Style Transferring via Adversarial Masking and Styled Filling (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for text style transfer suffer from two challenges: the word masking procedure may mistakenly remove unexpected words and the selected words in the word filling procedure lack diversity and semantic consistency. |
| Approach: | They propose a style transfer model with adversarial masking and styled filling techniques to solve these challenges. |
| Outcome: | The proposed model performs well on two benchmark text style transfer data sets. |
Cycle-Consistent Adversarial Autoencoders for Unsupervised Text Style Transfer (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for unsupervised text style transfer lack parallel data and difficulties in content preservation. |
| Approach: | They propose a neural approach to unsupervised text style transfer using non-parallel data. |
| Outcome: | The proposed approach can be trained end-to-end on two widely-used public datasets. |
How Positive Are You: Text Style Transfer using Adaptive Style Embedding (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches for unsupervised text style transfer are disentanglement between content and style. |
| Approach: | They propose to separate a model with a sentence reconstruction module and a style module to improve model architecture. |
| Outcome: | The proposed method improves style transfer performance and content preservation . the proposed method can be used to modify a sentence with a specified style attribute . |
Reinforcement Learning Based Text Style Transfer without Parallel Training Corpus (N19-1)
Copied to clipboard
| Challenge: | Existing methods for text style transfer have demonstrated considerable success, but a parallel corpus may not always be available for a transfer task. |
| Approach: | They propose a text style transfer model that uses an attention-based encoder-decoder to transfer a sentence from the source style to the target style. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two different style transfer tasks. |
Style Transformer: Unpaired Text Style Transfer without Disentangled Latent Representation (P19-1)
Copied to clipboard
| Challenge: | Disentangling the content and style in the latent space is prevalent in text style transfer . recurrent neural networks (RNN) based encoder and decoder cannot deal with the long-term dependency . |
| Approach: | They propose a style transformer which disentangles style information in latent space . they propose encoding and decoding methods that disentangle style information . |
| Outcome: | The proposed method can achieve better style transfer and better content preservation. |
Harnessing Pre-Trained Neural Networks with Rules for Formality Style Transfer (D19-1)
Copied to clipboard
| Challenge: | Existing studies normalize informal sentences with rules, but they introduce noise if we use them in a naive way. |
| Approach: | They propose to harness rules into a state-of-the-art neural network that is typically pretrained on massive corpora. |
| Outcome: | The proposed method can be used to generate a state-of-the-art on a small dataset. |
Style Transfer Through Back-Translation (P18-1)
Copied to clipboard
| Challenge: | a new method for automatic style transfer is proposed to preserve the meaning of the text while reducing stylistic properties. |
| Approach: | They propose a method for automatic style transfer that uses latent representations of the input sentence to preserve meaning while reducing stylistic properties. |
| Outcome: | The proposed method improves on sentiment, gender and political slant styles on three different styles. |
Towards Robust and Semantically Organised Latent Representations for Unsupervised Text Style Transfer (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent studies show that auto-encoders perform language generation, smooth sentence interpolation, and style transfer over unseen attributes using unlabelled datasets in a zero-shot manner. |
| Approach: | They propose a discrete token-based perturbation approach to map "similar" sentences close by in latent space. |
| Outcome: | The proposed model can generate and perform language generation, style transfer and sentence interpolation tasks on unlabelled datasets in a zero-shot manner. |
TextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restyling (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for text style transfer require style-labeled training data, but use only labeled data at inference time. |
| Approach: | They propose a method that uses readily-available unlabeled text to train style transfer . they use a style vector to condition a decoder to perform style transfer using unlabelled text . |
| Outcome: | The proposed method is competitive on sentiment transfer, even compared to models trained fully on labeled data. |
An Empirical Study on Multi-Task Learning for Text Style Transfer and Paraphrase Generation (2020.coling-industry)
Copied to clipboard
Pawel Bujnowski, Kseniia Ryzhova, Hyungtak Choi, Katarzyna Witkowska, Jaroslaw Piersa, Tymoteusz Krumholc, Katarzyna Beksa
| Challenge: | a limited amount of style data is needed for text style transfer, but there are no convincing methods for evaluating them. |
| Approach: | They propose an efficient method for neutral-to-style transformation using the transformer framework. |
| Outcome: | The proposed method can train neutral-to-style transformation models using large paraphrases and a small style transfer corpus. |