Challenge: Existing LLMs rely on remote API services, which creates privacy paradoxes and suboptimal solutions with severe utility collapse.
Approach: They propose a localized and training-free framework with an Attacker-Arbitrator-Anonymizer architecture that allows attackers to filter out ghost leaks.
Outcome: The proposed framework achieves superior privacy-utility trade-off compared to strong baselines.

Similar Papers

Robust Utility-Preserving Text Anonymization Based on Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing techniques face challenges of re-identification ability of large language models . anonymizing text that contains sensitive information is crucial for a wide range of applications .
Approach: They propose a framework that integrates three key LLM components to perform anonymization.
Outcome: The proposed model outperforms baselines while maintaining greater data utility in downstream tasks.
Adaptive Backtracking for Privacy Protection in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing privacy protection methods are prone to privacy leakage, but they are not effective in ensuring the privacy of users.
Approach: They propose to capture latent leakage tendency of large language models during generation process and to construct a new benchmark for personal information.
Outcome: The proposed method improves privacy by up to 14% over strong baselines against adversarial attacks, avoiding the degradation of response utility.
From Insight to Exploit: Leveraging LLM Collaboration for Adaptive Adversarial Text Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: LLMs can provide substantial zero-shot performance on diverse tasks, but it is crucial to assess their robustness against adversarial inputs.
Approach: They introduce Static Deceptor and Dynamic Deceptr to generate adversarial examples . they produce subtle and natural-looking adversarials that preserve semantic similarity to text .
Outcome: The proposed attacks are based on two LLM-based attacks that generate natural-looking examples that deceive the target LLM.
LLMs are Privacy Erasable (2025.findings-emnlp)

Copied to clipboard

Challenge: a new study examines the privacy of large language models and their capabilities . the study aims to address the balance between the convenience of LLMs and user privacy concerns .
Approach: They propose a strategy that safeguards user prompt while accessing LLM cloud services . they evaluate the efficacy of their method across prominent LLM benchmarks .
Outcome: The proposed method thwarts reconstruction attacks and improves model performance . it also surpasses the results reported in official model cards .
LDEDE: LRP-Driven Efficient Detection and Editing Framework for LLM Privacy Neurons (2026.findings-acl)

Copied to clipboard

Challenge: Existing privacy protection methods fail to cover context-dependent sensitive information and are prone to performance degradation.
Approach: They propose a Layer-wise Relevance Propagation-driven framework for efficient privacy neuron detection and editing.
Outcome: The proposed framework achieves 80% higher efficiency than gradient attribution methods while reducing leakage risks of Phone, Email, and medical privacy by 42.7%–73.5% on average and cutting computational time by 60%–90%.
Towards Privacy-Preserving Large Language Model: Text-free Inference Through Alignment and Adaptation (2026.acl-long)

Copied to clipboard

Challenge: Existing LLMs require users to submit raw text regardless of its sensitivity, resulting in substantial computational overhead and degrade model performance.
Approach: They propose a new training pipeline that allows a client-side encoder to condition on k-pooled prompt embeddings instead of raw text and a server-side projection module to fine-tune the projection module and LLM on private, domain-specific data using noise-injected embeddables.
Outcome: The proposed approach eliminates the need for transmitting raw prompt text while maintaining a favorable balance between privacy preservation and model utility for both clients and service providers.
Combating Security and Privacy Issues in the Era of Large Language Models (2024.naacl-tutorials)

Copied to clipboard

Challenge: a tutorial aims to provide a summary of risks and vulnerabilities in large language models . a number of studies have focused on security, privacy and copyright aspects of LLMs .
Approach: This tutorial seeks to provide a systematic summary of risks and vulnerabilities in large language models . authors will discuss security, privacy and copyright aspects of LLMs .
Outcome: This tutorial aims to provide a systematic summary of risks and vulnerabilities in large language models . it will also outline emerging challenges in security, privacy and reliability of LLMs .
Diversity Helps Jailbreak Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Existing methods for jailbreaking large language models rely on laborious human engineering and whitebox access to model internals.
Approach: They propose a method that instructs large language models to deviate from prior context and generate harmful outputs by instructing them to deviat from previous attacks.
Outcome: The proposed method achieves a 62.83% higher success rate in compromising ten leading chatbots, while using only 12.9% of the queries.
Adaptive Text Anonymization: Learning Privacy-Utility Trade-offs via Prompt Optimization (2026.findings-acl)

Copied to clipboard

Challenge: Existing methods for anonymizing textual documents lack flexibility to adapt to diverse requirements.
Approach: They propose a task formulation in which anonymization strategies are automatically adapted to specific privacy–utility requirements.
Outcome: The proposed framework achieves better privacy–utility trade-off than existing baselines on open-source language models while remaining computationally efficient and effective on larger closed-source models.
Beyond Numeric Rewards: In-Context Dueling Bandits with LLM Agents (2025.findings-acl)

Copied to clipboard

Challenge: In-Context Reinforcement Learning (ICRL) is a frontier paradigm for RL problems . authors find that LLMs can generalize cross-domain to perform ICRL on a stateless preference-based RL problem.
Approach: They propose an agentic-flow framework that integrates off-the-shelf DB algorithm support with LLM agents through fine-grained adaptive interplay.
Outcome: The proposed framework can generalize cross-domain to perform ICRL on a stateless preference-based RL problem.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations