Reinforcement Learning Based Text Style Transfer without Parallel Training Corpus (N19-1)
Copied to clipboard
| Challenge: | Existing methods for text style transfer have demonstrated considerable success, but a parallel corpus may not always be available for a transfer task. |
| Approach: | They propose a text style transfer model that uses an attention-based encoder-decoder to transfer a sentence from the source style to the target style. |
| Outcome: | The proposed model outperforms state-of-the-art methods on two different style transfer tasks. |
Similar Papers
Style Transfer Through Back-Translation (P18-1)
Copied to clipboard
| Challenge: | a new method for automatic style transfer is proposed to preserve the meaning of the text while reducing stylistic properties. |
| Approach: | They propose a method for automatic style transfer that uses latent representations of the input sentence to preserve meaning while reducing stylistic properties. |
| Outcome: | The proposed method improves on sentiment, gender and political slant styles on three different styles. |
Rethinking Style Transformer with Energy-based Interpretation: Adversarial Unsupervised Style Transfer using a Pretrained Model (2022.emnlp-main)
Copied to clipboard
Hojun Cho, Dohee Kim, Seungwoo Ryu, ChaeHun Park, Hyungjong Noh, Jeong-in Hwang, Minseok Choi, Edward Choi, Jaegul Choo
| Challenge: | Existing methods to train text style transfer models with adversarial loss degrade fluency compared to other metrics. |
| Approach: | They propose a method which leverages a pretrained language model to improve fluency by restructuring the discriminator and the model itself. |
| Outcome: | The proposed model achieves state-of-the-art on three public benchmarks and achieved state-outperformance on the overall metrics. |
An Empirical Study on Multi-Task Learning for Text Style Transfer and Paraphrase Generation (2020.coling-industry)
Copied to clipboard
Pawel Bujnowski, Kseniia Ryzhova, Hyungtak Choi, Katarzyna Witkowska, Jaroslaw Piersa, Tymoteusz Krumholc, Katarzyna Beksa
| Challenge: | a limited amount of style data is needed for text style transfer, but there are no convincing methods for evaluating them. |
| Approach: | They propose an efficient method for neutral-to-style transformation using the transformer framework. |
| Outcome: | The proposed method can train neutral-to-style transformation models using large paraphrases and a small style transfer corpus. |
Multi-Style Transfer with Discriminative Feedback on Disjoint Corpus (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for style transfer require joint annotations across all stylistic dimensions, limiting their application to multiple styles. |
| Approach: | They initialize an encoder-decoder setup with transformer-based language model pre-trained on a generic corpus and enhance its re-writing capability to multiple target style dimensions by employing multiple style-aware language models as discriminators. |
| Outcome: | The proposed model can control styles across multiple style dimensions while preserving content of the input text. |
STEER: Unified Style Transfer with Expert Reinforcement (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show unified style transfer models outperform the 175B instruction-tuned GPT-3 on overall style transfer quality. |
| Approach: | They propose a unified style transfer framework that can transfer to multiple target styles from an arbitrary source style. |
| Outcome: | The proposed method outperforms the 175B instruction-tuned GPT-3 on overall style transfer quality despite being 226 times smaller in size . |
Learning from Bootstrapping and Stepwise Reinforcement Reward: A Semi-Supervised Framework for Text Style Transfer (2022.findings-naacl)
Copied to clipboard
| Challenge: | Text style transfer is an important task in controllable language generation due to the scarcity of large-scale parallel data. |
| Approach: | They propose a semi-supervised framework for text style transfer that bootstraps with supervision guided by automatically constructed pseudo-parallel pairs and improves the sequence-to-sequence policy gradient via reinforcement rewards. |
| Outcome: | The proposed framework achieves state-of-the-art performance on multiple datasets and produces effective generation with as minimal as 10% of training data. |
Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Formality style transfer is the task of converting informal sentences to grammatically-correct formal sentences. |
| Approach: | They propose a semi-supervised formality style transfer model that utilizes a language model-based discriminator to maximize the likelihood of the output sentence being formal. |
| Outcome: | The proposed model outperforms state-of-the-art models in terms of automated metrics and human judgement. |
Transductive Learning for Unsupervised Text Style Transfer (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for style transfer are based on an inductive learning approach, which represents the style as embeddings, decoder parameters, or discriminator parameters and directly applies these general rules to the test cases. |
| Approach: | They propose a retrieval-based context-aware style representation that involves top-K relevant sentences in the target style in the transfer process. |
| Outcome: | The proposed method outperforms several strong baselines and is general and effective to the task of unsupervised style transfer. |
“Transforming” Delete, Retrieve, Generate Approach for Controlled Text Style Transfer (D19-1)
Copied to clipboard
| Challenge: | Text style transfer is the task of transferring the style of text having certain stylistic attributes, while preserving non-stylistic or content information. |
| Approach: | They propose a new approach to rewriting sentences to a target style in the absence of parallel style corpora by exploiting the Transformer. |
| Outcome: | The proposed method outperforms state-of-the-art systems across 5 datasets on sentiment, gender and political slant transfer. |
Text Style Transferring via Adversarial Masking and Styled Filling (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for text style transfer suffer from two challenges: the word masking procedure may mistakenly remove unexpected words and the selected words in the word filling procedure lack diversity and semantic consistency. |
| Approach: | They propose a style transfer model with adversarial masking and styled filling techniques to solve these challenges. |
| Outcome: | The proposed model performs well on two benchmark text style transfer data sets. |