Challenge: Existing methods for prompt privacy focus on document-level rewriting, neglecting rich, multi-granular representations of text.
Approach: a framework that leverages local differential privacy and composition theorem via group text rewriting is proposed . the framework is compatible with existing rewrite techniques and is publicly available at anonymous.4open.science for reproducibility.
Outcome: DP-GTR is the first framework to integrate document-level and word-level information while exploiting in-context learning to improve privacy and utility.

Similar Papers

DP-Rewrite: Towards Reproducibility and Transparency in Differentially Private Text Rewriting (2022.coling-1)

Copied to clipboard

Challenge: Existing systems for differentially private text rewriting lack the means to validate privacy-preserving claims.
Approach: They propose an open-source framework for differentially private text rewriting which is modular, extensible and highly customizable.
Outcome: The proposed framework provides a way to lead and validate private text rewriting research.
DP3: Differentially Private Prompt Perturbation for Multi-turn LLM Inference (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are widely used for text understanding and generation . existing methods that assume single-turn interactions break down in multi-turn settings .
Approach: They propose a differentially private prompt perturbation framework for multi-turn LLM inference . DP3 constructs a perturbation mapping table to reuse perturbations for recurring tokens .
Outcome: The proposed framework reduces privacy costs and degrades cross-turn semantic coherence . it also provides a context-aware utility function to maintain semantic consistency across turns .
Thinking Outside of the Differential Privacy Box: A Case Study in Text Privatization with Language Model Prompting (2024.emnlp-main)

Copied to clipboard

Challenge: Recent studies have focused on the integration of Differential Privacy (DP) into NLP techniques.
Approach: They propose a method for text privatization leveraging language models to rewrite texts . they examine the usability of DP in NLP and its benefits over non-DP approaches .
Outcome: The proposed method is a novel method for text privatization leveraging language models to rewrite texts.
Locally Differentially Private Document Generation Using Zero Shot Prompting (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing privacy protections are limited by pretrained large language models . a new mechanism that leverages the power of large language model de-anonymization is proposed .
Approach: They propose a locally differentially private mechanism that leverages pretrained large language models to counter author de-anonymization attacks by minimizing the impact on downstream utility.
Outcome: The proposed mechanism reduces the success rate of de-anonymization attacks against IMDB datasets while minimizing the impact on downstream utility.
DP-MLM: Differentially Private Text Rewriting Using Masked Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for text privatization using Differential Privacy rely on autoregressive models which lack a mechanism to contextualize the private rewriting process.
Approach: They propose a method for differentially private text rewriting using masked language models to rewrite a text one token at a time.
Outcome: The proposed method preserves utility at lower levels, compared to previous methods relying on autoregressive models with a decoder.
Leveraging Semantic Triples for Private Document Generation with Local Differential Privacy Guarantees (2025.emnlp-main)

Copied to clipboard

Challenge: Existing studies on differential privacy in text privatization use word perturbations and rewriting methods to protect privacy.
Approach: They propose a method which leverages semantic triples for neighborhood-aware private document generation under local DP guarantees.
Outcome: The proposed method allows for coherent text generation even at lower values while still balancing privacy and utility.
How reparametrization trick broke differentially-private text representation learning (2022.acl-short)

Copied to clipboard

Challenge: Differential privacy (DP) is a formal mathematical treatment of privacy protection . it guarantees how much privacy can be lost in the worst case . adapting DP mechanisms to NLP properly is largely non-trivial task .
Approach: They propose to use differential privacy to learn text representations using DPText to quantify and guarantee how much privacy can be lost in the worst case.
Outcome: The proposed methods are falsely claimed to be differentially private and violate privacy loss guarantees.
Public Data Assisted Differentially Private In-Context Learning (2025.findings-emnlp)

Copied to clipboard

Challenge: In-context learning has shown remarkable performance across tasks without fine-tuning . however, recent studies have highlighted the risk of private data leakage through the prompt in ICL .
Approach: They propose a private in-context learning algorithm that effectively balances privacy protection and model utility.
Outcome: The proposed algorithm is robust against membership inference attacks and is robust to membership infertility attacks.
Differentially Private Language Models for Secure Data Sharing (2022.emnlp-main)

Copied to clipboard

Challenge: a variety of deanonymization attacks allow the re-identification of individuals from tabular data.
Approach: They propose to train a language model in a differentially private manner and sample data from it . they find that the model generates fluent textual datasets with privacy guarantees .
Outcome: The proposed methods outperform direct classifiers with DP-SGD in the real-world.
SharedRequest: Privacy-Preserving Model-Agnostic Inference for Large Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing privacy-preserving inference methods sacrifice utility or efficiency, authors say . current approaches suffer a trilemma between privacy, utility, and efficiency, they say .
Approach: They propose a model-agnostic framework for privacy-preserving LLM inference that reformulates privacy protection at the batch level rather than the individual-prompt level.
Outcome: The proposed model-agnostic framework achieves 20% higher utility than previous models . it reduces query cost by up to 5 compared to non-batched inference .

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations