Dear Sir or Madam, May I Introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfer (N18-1)
Copied to clipboard
| Challenge: | a lack of training and evaluation datasets, benchmarks and automatic metrics has blocked progress in this field. |
| Approach: | They propose to use a grammarly's Yahoo Answers Formality corpus to create the largest corpus for a particular style . they also propose to apply machine translation metrics to the task . |
| Outcome: | The proposed model can be used to train and evaluate a text in a particular style . the proposed model is based on the existing model and can be applied to other tasks . |
Similar Papers
Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfer (2021.emnlp-main)
Copied to clipboard
| Challenge: | a lack of standardized and reliable methods for automatic evaluation hinders ST . prior work has employed as many as nine different automatic systems to rate formality alone . |
| Approach: | They evaluate automatic metrics on the oft-researched task of formality style transfer . they outline best practices for automatic evaluation in (formality) style transfer and identify models that correlate well with human judgments. |
| Outcome: | The proposed models correlate well with human judgments and are robust across languages. |
Towards Actual (Not Operational) Textual Style Transfer Auto-Evaluation (D19-55)
Copied to clipboard
| Challenge: | elucidates the dangerous current state of style transfer auto-evaluation research. |
| Approach: | They propose ways to aggregate the three metrics into one evaluator. |
| Outcome: | The proposed method could be used to aggregate the three metrics into one evaluator. |
Parallel Data Augmentation for Formality Style Transfer (2020.acl-main)
Copied to clipboard
| Challenge: | Formality style transfer is a task of automatically transforming text in one particular formality style into another. |
| Approach: | They propose to augment parallel data with three specific data augmentation methods to improve the model's generalization ability and reduce the overfitting risk. |
| Outcome: | The proposed methods significantly improve performance when used to pre-train the model and lead to the state-of-the-art results in the GYAFC benchmark dataset. |
Formality Style Transfer for Noisy, User-generated Conversations: Extracting Labeled, Parallel Data from Unlabeled Corpora (D19-55)
Copied to clipboard
| Challenge: | Typical datasets used for style transfer in NLP contain aligned pairs of two opposite extremes of a style. |
| Approach: | They propose a technique to derive a dataset of aligned pairs from an unlabeled corpus by using an auxiliary dataset, allowing for in-domain training. |
| Outcome: | The proposed method significantly outperforms OpenNMT’s Seq2Seq model trained on the Yahoo Formality Dataset and 6 novel datasets. |
Olá, Bonjour, Salve! XFORMAL: A Benchmark for Multilingual Formality Style Transfer (2021.naacl-main)
Copied to clipboard
| Challenge: | XFORMAL benchmarks formal reformulations of informal text in Brazilian Portuguese, French, and Italian . most work on style transfer within English, while covering different languages has received disproportional interest. |
| Approach: | They create a benchmark of multiple formal reformulations of informal text in Brazil, Brazil, and Italy. |
| Outcome: | XFORMAL benchmarks formal reformulations of informal text in Brazilian Portuguese, French, and Italian . results show that state-of-the-art approaches perform close to simple baselines . |
An Empirical Study on Multi-Task Learning for Text Style Transfer and Paraphrase Generation (2020.coling-industry)
Copied to clipboard
Pawel Bujnowski, Kseniia Ryzhova, Hyungtak Choi, Katarzyna Witkowska, Jaroslaw Piersa, Tymoteusz Krumholc, Katarzyna Beksa
| Challenge: | a limited amount of style data is needed for text style transfer, but there are no convincing methods for evaluating them. |
| Approach: | They propose an efficient method for neutral-to-style transformation using the transformer framework. |
| Outcome: | The proposed method can train neutral-to-style transformation models using large paraphrases and a small style transfer corpus. |
Evaluating Text Style Transfer Evaluation: Are There Any Reliable Metrics? (2025.naacl-srw)
Copied to clipboard
| Challenge: | Text style transfer (TST) is a multidimensional task requiring the assessment of style transfer accuracy, content preservation, and naturalness. |
| Approach: | They propose to use text style transfer metrics to evaluate outputs of text editors . they also investigate the potential of large language models as tools for TST evaluation . |
| Outcome: | The proposed methods provide better insights than existing metrics, the authors show . their meta-evaluation through correlation with hu-man judgments shows they are effective . |
Harnessing Pre-Trained Neural Networks with Rules for Formality Style Transfer (D19-1)
Copied to clipboard
| Challenge: | Existing studies normalize informal sentences with rules, but they introduce noise if we use them in a naive way. |
| Approach: | They propose to harness rules into a state-of-the-art neural network that is typically pretrained on massive corpora. |
| Outcome: | The proposed method can be used to generate a state-of-the-art on a small dataset. |
Style Transfer Through Back-Translation (P18-1)
Copied to clipboard
| Challenge: | a new method for automatic style transfer is proposed to preserve the meaning of the text while reducing stylistic properties. |
| Approach: | They propose a method for automatic style transfer that uses latent representations of the input sentence to preserve meaning while reducing stylistic properties. |
| Outcome: | The proposed method improves on sentiment, gender and political slant styles on three different styles. |
Formality Style Transfer with Shared Latent Space (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches for formality style transfer use neural networks for sentence generation, but the dataset for formal style transfer is considerably smaller than translation corpora. |
| Approach: | They propose a new approach for formality style transfer using shared latent space and two auxiliary losses. |
| Outcome: | The proposed approach outperforms baselines in various settings, especially when limited data is available. |