The Impact of Differential Privacy on Group Disparity Mitigation (2024.findings-naacl)
Copied to clipboard
| Challenge: | a recent study evaluated the impact of differential privacy on fairness across four tasks. |
| Approach: | They evaluate the impact of differential privacy on fairness across four diverse tasks . they train (,)-differentially private models with empirical risk minimization . |
| Outcome: | The proposed model shows that differential privacy increases performance differences between groups . the model also reduces performance differences in the robust setting . |
Similar Papers
A Comparative Analysis of Word-Level Metric Differential Privacy: Benchmarking the Privacy-Utility Trade-off (2024.lrec-main)
Copied to clipboard
| Challenge: | Differential Privacy (DP) has been used in NLP for years to address privacy concerns . privacy-enhancing technologies (PETs) are concrete technical solutions that can be incorporated into existing systems. |
| Approach: | They compare different Differential Privacy algorithms for word-level NLP tasks . they propose concrete steps forward to combat privacy risks in NLP settings . |
| Outcome: | The proposed methods perform better than the proposed methods on two NLP tasks. |
How reparametrization trick broke differentially-private text representation learning (2022.acl-short)
Copied to clipboard
| Challenge: | Differential privacy (DP) is a formal mathematical treatment of privacy protection . it guarantees how much privacy can be lost in the worst case . adapting DP mechanisms to NLP properly is largely non-trivial task . |
| Approach: | They propose to use differential privacy to learn text representations using DPText to quantify and guarantee how much privacy can be lost in the worst case. |
| Outcome: | The proposed methods are falsely claimed to be differentially private and violate privacy loss guarantees. |
Trade-Offs Between Fairness and Privacy in Language Modeling (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing research suggests that privacy preservation comes at the price of worsening biases in classification tasks. |
| Approach: | They propose to incorporate privacy preservation and de-biasing techniques into training text generation models to investigate the trade-off between the two dimensions. |
| Outcome: | The proposed model improves on bias detection, privacy attacks, language modeling, and performance on downstream tasks. |
When differential privacy meets NLP: The devil is in the detail (2021.emnlp-main)
Copied to clipboard
| Challenge: | Differential privacy provides a formal approach to privacy of individuals. |
| Approach: | They propose to use ADePT to provide differentially private auto-encoders for text rewriting to provide tight privacy guarantees for users' original utterances. |
| Outcome: | The proposed algorithm is not differentially private, thus rendering the experimental results unsubstantiated. |
One size does not fit all: Investigating strategies for differentially-private learning across NLP tasks (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing research on the efficiency of differentially-private stochastic gradient descent (DP-SGD) in NLP is inconclusive or even counter-intuitive. |
| Approach: | They propose to use differentially-private stochastic gradient descent (DP-SGD) to preserve privacy in NLP by using modern neural models based on BERT and XtremeDistil architectures to conduct extensive experiments. |
| Outcome: | The proposed models and training strategies provide the best trade-off between privacy and performance on different NLP tasks. |
To Share or Not to Share: What Risks Would Laypeople Accept to Give Sensitive Data to Differentially-Private NLP Systems? (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing studies on differential privacy in NLP mainly focus on technical aspects, neglecting the human perception of privacy risks. |
| Approach: | They propose to use a differentially private algorithm to determine the privacy budget to determine which values are acceptable in which situations. |
| Outcome: | The proposed study aims to determine what thresholds would lead lay people to share sensitive textual data. |
Privacy Regularization: Joint Privacy-Utility Optimization in LanguageModels (2021.naacl-main)
Copied to clipboard
Fatemehsadat Mireshghallah, Huseyin Inan, Marcello Hasegawa, Victor Rühle, Taylor Berg-Kirkpatrick, Robert Sim
| Challenge: | Neural language models have a high capacity for memorization of training samples . however, this can cause privacy degradation and disparate impact on subgroups of users . |
| Approach: | They propose two privacy-preserving regularization methods for training language models that enable joint optimization of utility and privacy. |
| Outcome: | The proposed methods have favorable utility-privacy trade-off, faster training and uniform treatment of under-represented subgroups. |
Thinking Outside of the Differential Privacy Box: A Case Study in Text Privatization with Language Model Prompting (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have focused on the integration of Differential Privacy (DP) into NLP techniques. |
| Approach: | They propose a method for text privatization leveraging language models to rewrite texts . they examine the usability of DP in NLP and its benefits over non-DP approaches . |
| Outcome: | The proposed method is a novel method for text privatization leveraging language models to rewrite texts. |
Differentially Private Language Models for Secure Data Sharing (2022.emnlp-main)
Copied to clipboard
| Challenge: | a variety of deanonymization attacks allow the re-identification of individuals from tabular data. |
| Approach: | They propose to train a language model in a differentially private manner and sample data from it . they find that the model generates fluent textual datasets with privacy guarantees . |
| Outcome: | The proposed methods outperform direct classifiers with DP-SGD in the real-world. |
On the Impact of Noise in Differentially Private Text Rewriting (2025.findings-naacl)
Copied to clipboard
| Challenge: | a field of text privatization often requires the addition of noise to vector representations of text . however, noise addition leads to considerable utility loss, highlighting one drawback of DP in NLP. |
| Approach: | They propose a sentence-infilling privatization technique that adds noise to vector representations of text to provide privacy guarantees. |
| Outcome: | The proposed method shows that non-DP privatization methods excel in utility preservation and can find an acceptable privacy-utility trade-off, but cannot outperform DP methods in empirical privacy protections. |