On the Impact of Noise in Differentially Private Text Rewriting (2025.findings-naacl)
Copied to clipboard
| Challenge: | a field of text privatization often requires the addition of noise to vector representations of text . however, noise addition leads to considerable utility loss, highlighting one drawback of DP in NLP. |
| Approach: | They propose a sentence-infilling privatization technique that adds noise to vector representations of text to provide privacy guarantees. |
| Outcome: | The proposed method shows that non-DP privatization methods excel in utility preservation and can find an acceptable privacy-utility trade-off, but cannot outperform DP methods in empirical privacy protections. |
Similar Papers
Thinking Outside of the Differential Privacy Box: A Case Study in Text Privatization with Language Model Prompting (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have focused on the integration of Differential Privacy (DP) into NLP techniques. |
| Approach: | They propose a method for text privatization leveraging language models to rewrite texts . they examine the usability of DP in NLP and its benefits over non-DP approaches . |
| Outcome: | The proposed method is a novel method for text privatization leveraging language models to rewrite texts. |
DP-Rewrite: Towards Reproducibility and Transparency in Differentially Private Text Rewriting (2022.coling-1)
Copied to clipboard
| Challenge: | Existing systems for differentially private text rewriting lack the means to validate privacy-preserving claims. |
| Approach: | They propose an open-source framework for differentially private text rewriting which is modular, extensible and highly customizable. |
| Outcome: | The proposed framework provides a way to lead and validate private text rewriting research. |
How reparametrization trick broke differentially-private text representation learning (2022.acl-short)
Copied to clipboard
| Challenge: | Differential privacy (DP) is a formal mathematical treatment of privacy protection . it guarantees how much privacy can be lost in the worst case . adapting DP mechanisms to NLP properly is largely non-trivial task . |
| Approach: | They propose to use differential privacy to learn text representations using DPText to quantify and guarantee how much privacy can be lost in the worst case. |
| Outcome: | The proposed methods are falsely claimed to be differentially private and violate privacy loss guarantees. |
DP-BART for Privatized Text Rewriting under Local Differential Privacy (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing systems that guarantee privacy protection to individuals face several problems, such as formal mathematical flaws, unrealistic privacy guarantees, and privatization of only individual words. |
| Approach: | They propose a system that enables sharing of sensitive textual documents while formally guaranteeing privacy protection to individuals. |
| Outcome: | The proposed system outperforms existing LDP systems in terms of noise and privacy guarantees. |
When differential privacy meets NLP: The devil is in the detail (2021.emnlp-main)
Copied to clipboard
| Challenge: | Differential privacy provides a formal approach to privacy of individuals. |
| Approach: | They propose to use ADePT to provide differentially private auto-encoders for text rewriting to provide tight privacy guarantees for users' original utterances. |
| Outcome: | The proposed algorithm is not differentially private, thus rendering the experimental results unsubstantiated. |
Differentially Private Representation for NLP: Formal Guarantee and An Empirical Study on Privacy and Fairness (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to learn text representations can encode private information of the input, thus can be exploited to recover such information with reasonable accuracy. |
| Approach: | They propose a novel approach to preserve privacy of the extracted representation from text by combining differential privacy with dropout. |
| Outcome: | The proposed approach preserves privacy of the extracted representation from text while masking words via dropout can enhance privacy. |
DP-MLM: Differentially Private Text Rewriting Using Masked Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for text privatization using Differential Privacy rely on autoregressive models which lack a mechanism to contextualize the private rewriting process. |
| Approach: | They propose a method for differentially private text rewriting using masked language models to rewrite a text one token at a time. |
| Outcome: | The proposed method preserves utility at lower levels, compared to previous methods relying on autoregressive models with a decoder. |
Leveraging Semantic Triples for Private Document Generation with Local Differential Privacy Guarantees (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on differential privacy in text privatization use word perturbations and rewriting methods to protect privacy. |
| Approach: | They propose a method which leverages semantic triples for neighborhood-aware private document generation under local DP guarantees. |
| Outcome: | The proposed method allows for coherent text generation even at lower values while still balancing privacy and utility. |
Differentially Private Natural Language Models: Recent Advances and Future Directions (2024.findings-eacl)
Copied to clipboard
| Challenge: | Recent advances in deep learning have led to great success in various natural language processing tasks. |
| Approach: | They propose a systematic review of recent advances in DP deep learning models . they discuss some differences and additional challenges of DP-NLP . |
| Outcome: | The proposed method can prevent reconstruction attacks and protect against potential side knowledge while maintaining the privacy of sensitive data. |
ADePT: Auto-encoder based Differentially Private Text Transformation (2021.eacl-main)
Copied to clipboard
| Challenge: | Differential privacy is an important privacy concern when building statistical models on data containing sensitive information. |
| Approach: | They propose a utility-preserving differentially private text transformation algorithm using auto-encoders that can be used to transform text to offer robustness against attacks and produce transformations with high semantic quality. |
| Outcome: | The proposed model performs better against membership inference attacks while offering lower to no degradation in the utility of the underlying transformation process compared to baselines. |