A Customized Text Sanitization Mechanism with Differential Privacy (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to sanitize texts subject to differential privacy do not work for non-metric semantic similarity measures. |
| Approach: | They propose a customized text sanitization mechanism based on a metric local differential privacy definition. |
| Outcome: | The proposed mechanism achieves better privacy-utility trade-offs than existing mechanisms on benchmark datasets. |
Similar Papers
CluSanT: Differentially Private and Semantically Coherent Text Sanitization (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing implementations of Differential Privacy (DP) in NLP typically degrade semantic integrity and readability for humans, posing significant challenges for applications requiring high-quality, coherent text processing. |
| Approach: | They propose a text sanitization framework based on Metric Local Differential Privacy (MLDP) that uses large language models to create a set of potential substitute tokens and a parameterized cluster embedding to samaritize/substitute sensitive tokens. |
| Outcome: | The proposed framework can be tuned with parameters such that existing state-of-the-art token sanitization algorithms can be described and improved. |
Differential Privacy for Text Analytics via Natural Text Sanitization (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing text sanitization mechanisms provide low utility, as cursed by the high-dimensional text representation. |
| Approach: | They propose to use sanitized texts to samaritize training data . they propose to retrain and fine-tune the senitization-aware language model . |
| Outcome: | The proposed approach enables privacypreserving natural language processing over the BERT language model with promising utility. |
DYNTEXT: Semantic-Aware Dynamic Text Sanitization for Privacy-Preserving LLM Inference (2025.findings-acl)
Copied to clipboard
Juhua Zhang, Zhiliang Tian, Minghang Zhu, Yiping Song, Taishu Sheng, Siyi Yang, Qiunan Du, Xinwang Liu, Minlie Huang, Dongsheng Li
| Challenge: | Existing methods to protect privacy of sensitive data are differential privacy (DP) and DP is used to protect users from privacy leakage. |
| Approach: | They propose an LDP-based Dynamic Text sanitization for privacy-preserving LLM inference that dynamically constructs semantic-aware adjacency lists of sensitive tokens to sample non-sensitive tokens for perturbation. |
| Outcome: | The proposed model excels on three datasets. |
Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipe (2023.acl-long)
Copied to clipboard
Xiang Yue, Huseyin Inan, Xuechen Li, Girish Kumar, Julia McAnallen, Hoda Shajari, Huan Sun, David Levitan, Robert Sim
| Challenge: | Privacy concerns have increased in data-driven products due to the tendency of machine learning models to memorize sensitive training data. |
| Approach: | They propose a method for generating useful synthetic text with a formal privacy guarantee by fine-tuning a pretrained generative language model with DP. |
| Outcome: | The proposed method produces synthetic text competitive in terms of utility with its non-private counterpart, while providing strong protection against potential privacy leakages. |
Neural Text Sanitization with Explicit Measures of Privacy Risk (2022.aacl-main)
Copied to clipboard
| Challenge: | Personal data, also known as Personally Identifiable Information (PII), often abound in text documents. |
| Approach: | They propose a method for text sanitization that uses a neural entity recognizer to detect and classify potential personal identifiers and a classifier trained on labelled data to determine which entities to mask . |
| Outcome: | The proposed approach masks all personal identifiers and thereby conceals the identity of the individuals mentioned in the document. |
Thinking Outside of the Differential Privacy Box: A Case Study in Text Privatization with Language Model Prompting (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have focused on the integration of Differential Privacy (DP) into NLP techniques. |
| Approach: | They propose a method for text privatization leveraging language models to rewrite texts . they examine the usability of DP in NLP and its benefits over non-DP approaches . |
| Outcome: | The proposed method is a novel method for text privatization leveraging language models to rewrite texts. |
How reparametrization trick broke differentially-private text representation learning (2022.acl-short)
Copied to clipboard
| Challenge: | Differential privacy (DP) is a formal mathematical treatment of privacy protection . it guarantees how much privacy can be lost in the worst case . adapting DP mechanisms to NLP properly is largely non-trivial task . |
| Approach: | They propose to use differential privacy to learn text representations using DPText to quantify and guarantee how much privacy can be lost in the worst case. |
| Outcome: | The proposed methods are falsely claimed to be differentially private and violate privacy loss guarantees. |
ADePT: Auto-encoder based Differentially Private Text Transformation (2021.eacl-main)
Copied to clipboard
| Challenge: | Differential privacy is an important privacy concern when building statistical models on data containing sensitive information. |
| Approach: | They propose a utility-preserving differentially private text transformation algorithm using auto-encoders that can be used to transform text to offer robustness against attacks and produce transformations with high semantic quality. |
| Outcome: | The proposed model performs better against membership inference attacks while offering lower to no degradation in the utility of the underlying transformation process compared to baselines. |
A Comparative Analysis of Word-Level Metric Differential Privacy: Benchmarking the Privacy-Utility Trade-off (2024.lrec-main)
Copied to clipboard
| Challenge: | Differential Privacy (DP) has been used in NLP for years to address privacy concerns . privacy-enhancing technologies (PETs) are concrete technical solutions that can be incorporated into existing systems. |
| Approach: | They compare different Differential Privacy algorithms for word-level NLP tasks . they propose concrete steps forward to combat privacy risks in NLP settings . |
| Outcome: | The proposed methods perform better than the proposed methods on two NLP tasks. |
DPGA-TextSyn: Differentially Private Genetic Algorithm for Synthetic Text Generation (2025.findings-acl)
Copied to clipboard
Zhonghao Sun, Zhiliang Tian, Yiping Song, Yuyi Si, Juhua Zhang, Minlie Huang, Kai Lu, Zeyu Xiong, Xinwang Liu, Dongsheng Li
| Challenge: | Existing methods to fine-tune large language models pose privacy risks . researchers have synthesized data with strong generation capabilities closed-source LLMs to alleviate this problem . |
| Approach: | They propose to combine general LLMs with genetic algorithm to produce relevant and diverse synthetic text under differential privacy constraints. |
| Outcome: | The proposed method significantly improves the performance of the model in downstream tasks while ensuring privacy. |