StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examples (2025.naacl-long)
Copied to clipboard
Ajay Patel, Jiacheng Zhu, Justin Qiu, Zachary Horvitz, Marianna Apidianaki, Kathleen McKeown, Chris Callison-Burch
| Challenge: | Existing methods for embedding text are limited by the imperfect nature of data acquired under such assumptions. |
| Approach: | They propose a new approach to training stronger content-independent style embeddings using a synthetic dataset of near-exact paraphrases with controlled style variations. |
| Outcome: | The proposed model outperforms existing methods in real-world benchmarks and outperformed leading style representations in downstream applications. |
Similar Papers
mStyleDistance: Multilingual Style Embeddings and their Evaluation (2025.findings-acl)
Copied to clipboard
| Challenge: | Multilingual StyleDistance embeddings are useful for stylistic analysis and style transfer, but they only exist for English. |
| Approach: | They propose a method that can generate style embeddings in new languages using synthetic data and a contrastive loss. |
| Outcome: | The proposed method outperforms existing style embeddings on these benchmarks and generalizes well to unseen features and languages. |
Learning Interpretable Style Embeddings via Prompting LLMs (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work has treated the style of a text as separable from the content. |
| Approach: | They use prompting to perform stylometry on a large number of texts to generate a synthetic stylometric dataset. |
| Outcome: | The proposed model trains human-interpretable representations on a large stylometric dataset and a linguistic model for style representation learning. |
Data-to-Text Generation with Style Imitation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent approaches to data-to-text generation focus on improving content fidelity, but lack explicit control over writing styles. |
| Approach: | They propose a way to control writing styles by using existing sentences as "soft" templates . they conduct experiments in restaurants and sports domains to test their approach . |
| Outcome: | The proposed approach achieves stronger performance than a range of comparison methods. |
Parallel Data Augmentation for Formality Style Transfer (2020.acl-main)
Copied to clipboard
| Challenge: | Formality style transfer is a task of automatically transforming text in one particular formality style into another. |
| Approach: | They propose to augment parallel data with three specific data augmentation methods to improve the model's generalization ability and reduce the overfitting risk. |
| Outcome: | The proposed methods significantly improve performance when used to pre-train the model and lead to the state-of-the-art results in the GYAFC benchmark dataset. |
How Positive Are You: Text Style Transfer using Adaptive Style Embedding (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches for unsupervised text style transfer are disentanglement between content and style. |
| Approach: | They propose to separate a model with a sentence reconstruction module and a style module to improve model architecture. |
| Outcome: | The proposed method improves style transfer performance and content preservation . the proposed method can be used to modify a sentence with a specified style attribute . |
Towards Robust and Semantically Organised Latent Representations for Unsupervised Text Style Transfer (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent studies show that auto-encoders perform language generation, smooth sentence interpolation, and style transfer over unseen attributes using unlabelled datasets in a zero-shot manner. |
| Approach: | They propose a discrete token-based perturbation approach to map "similar" sentences close by in latent space. |
| Outcome: | The proposed model can generate and perform language generation, style transfer and sentence interpolation tasks on unlabelled datasets in a zero-shot manner. |
From Semantics to Style: A Cross-Dataset Comparative Framework for Sentence Similarity Predictions (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing frameworks for analyzing text embedding models are limited. |
| Approach: | They propose a framework that uses lightweight poolers to analyze STS, PI, and Triplet datasets. |
| Outcome: | The proposed framework shows that the model captures semantic differences between sentences and is consistent across datasets. |
Text Style Transfer for Bias Mitigation using Masked Language Modeling (2022.naacl-srw)
Copied to clipboard
| Challenge: | Various research findings have concluded that biased textual data has significant effects on target demographic groups. |
| Approach: | They propose a text-style transfer model that can be trained on non-parallel data and be used to automatically mitigate bias in textual data. |
| Outcome: | The proposed model improves on limitations of existing methods while maintaining good style transfer accuracy. |
StyleDGPT: Stylized Response Generation with Pre-trained Language Models (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for generating responses following a desired style are lacking of parallel data for training. |
| Approach: | They propose a KL loss and a style classifier to fine-tune response generation . they show that their model can significantly outperform state-of-the-art methods . |
| Outcome: | The proposed model outperforms state-of-the-art models in style consistency and contextual coherence with two public datasets. |
Disentangled Representation Learning for Non-Parallel Text Style Transfer (P19-1)
Copied to clipboard
| Challenge: | a paper aims to disentangle latent representations of style and content in language models . auxiliary multi-task and adversarial objectives are used to disentangle the latent space . |
| Approach: | They propose a simple yet effective approach to disentangling latent representations . they propose auxiliary multi-task and adversarial objectives to disentangle style and content . |
| Outcome: | The proposed approach achieves high performance in terms of transfer accuracy, content preservation, and language fluency compared to previous approaches . |