Preventing Author Profiling through Zero-Shot Multilingual Back-Translation (2021.emnlp-main)
Copied to clipboard
| Challenge: | Documents as short as a single sentence may reveal sensitive information about authors . style transfer is effective but a number of current methods cause a drop in down-stream utility . |
| Approach: | They propose a method to remove sensitive information from documents by multilingual back-translation using off-the-shelf translation models. |
| Outcome: | The proposed method lowers adversarial gender and race prediction by 22% while retaining 95% of original utility on downstream tasks. |
Similar Papers
Few-shot Controllable Style Transfer for Low-Resource Multilingual Settings (2022.acl-long)
Copied to clipboard
| Challenge: | Existing methods for few-shot style transfer often copy inputs verbatim . a new method is better at controlling the style transfer magnitude using an input scalar knob. |
| Approach: | They propose a method to model the stylistic difference between paraphrases by rewriting a sentence into a target style while preserving semantics. |
| Outcome: | The proposed method achieves 2-3x better performance in formality transfer and code-mixing addition across seven languages. |
TextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restyling (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for text style transfer require style-labeled training data, but use only labeled data at inference time. |
| Approach: | They propose a method that uses readily-available unlabeled text to train style transfer . they use a style vector to condition a decoder to perform style transfer using unlabelled text . |
| Outcome: | The proposed method is competitive on sentiment transfer, even compared to models trained fully on labeled data. |
Text Style Transfer for Bias Mitigation using Masked Language Modeling (2022.naacl-srw)
Copied to clipboard
| Challenge: | Various research findings have concluded that biased textual data has significant effects on target demographic groups. |
| Approach: | They propose a text-style transfer model that can be trained on non-parallel data and be used to automatically mitigate bias in textual data. |
| Outcome: | The proposed model improves on limitations of existing methods while maintaining good style transfer accuracy. |
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning (2022.coling-1)
Copied to clipboard
Kunbo Ding, Weijie Liu, Yuejian Fang, Weiquan Mao, Zhe Zhao, Tao Zhu, Haoyan Liu, Rong Tian, Yiren Chen
| Challenge: | Existing zero-shot cross-lingual transfer methods rely on parallel corpora or bilingual dictionaries . however, its effect is limited by the gap between embedding clusters of different languages . |
| Approach: | They propose Embedding-Push, Attention-Pull, and Robust targets to transfer English embeddings to virtual multilingual embedders without semantic loss. |
| Outcome: | Experimental results show that the proposed method outperforms existing methods on cross-lingual tasks and can achieve a better multilingual alignment. |
Style Transfer Through Back-Translation (P18-1)
Copied to clipboard
| Challenge: | a new method for automatic style transfer is proposed to preserve the meaning of the text while reducing stylistic properties. |
| Approach: | They propose a method for automatic style transfer that uses latent representations of the input sentence to preserve meaning while reducing stylistic properties. |
| Outcome: | The proposed method improves on sentiment, gender and political slant styles on three different styles. |
Massively Multilingual Transfer for NER (P19-1)
Copied to clipboard
| Challenge: | Existing approaches for cross-lingual transfer use a single source language, but there are exceptions. |
| Approach: | They propose two techniques for modulating the transfer, suitable for zero-shot or few-shot learning, respectively. |
| Outcome: | The proposed methods are much more effective than baseline models and rival oracle selection of the single best individual model. |
TinyStyler: Efficient Few-Shot Text Style Transfer with Authorship Embeddings (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for text style transfer rely on few-shot capabilities of large language models or complex controllable text generation approaches that are inefficient and underperform on fluency metrics. |
| Approach: | They propose a lightweight but effective approach which leverages a small language model and pre-trained authorship embeddings to perform efficient, few-shot text style transfer. |
| Outcome: | The proposed method outperforms strong approaches such as GPT-4 and performs form attribute style transfer with automatic and human evaluations. |
StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content Enhancing (2023.acl-long)
Copied to clipboard
| Challenge: | Existing studies on text style transfer neglect long style transfer at the discourse level. |
| Approach: | They propose a model that transfers text style into target styles with learnable style embeddings . they use a mask-and-fill framework to explicitly fuse style-specific keywords into generation . |
| Outcome: | The proposed model outperforms baselines in style transfer and content preservation. |
Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Models (2022.emnlp-main)
Copied to clipboard
| Challenge: | a new method for textual style transfer is proposed for text with a limited set of style choices . textual styles are a complex task that requires specialized models to perform . |
| Approach: | They propose a method for arbitrary textual style transfer using pre-trained language models . they use a mathematical formulation of the TST task, decomposing it into three components . |
| Outcome: | The proposed method performs on par with state-of-the-art large-scale models while using less compute and memory. |
”Diversity and Uncertainty in Moderation” are the Key to Data Selection for Multilingual Few-shot Transfer (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches for few-shot transfer show significant gain over zero-shot transfers . language resource distribution is skewed across the world's languages . proposed methods use multiple measures such as data entropy and gradient embedding . |
| Approach: | They propose a loss embedding method for sequence labeling tasks that induces diversity and uncertainty sampling similar to gradient embeddment. |
| Outcome: | The proposed methods outperform baseline methods for POS tagging, NER, and NLI tasks for up to 20 languages. |