Protecting Users From Themselves: Safeguarding Contextual Privacy in Interactions with Conversational Agents (2025.findings-acl)
Copied to clipboard
Ivoline C. Ngong, Swanand Ravindra Kadhe, Hao Wang, Keerthiram Murugesan, Justin D. Weisz, Amit Dhurandhar, Karthikeyan Natesan Ramamurthy
| Challenge: | Conversational agents are increasingly woven into individuals’ personal lives, yet users underestimate the privacy risks associated with them. |
| Approach: | They propose a framework that allows users to reformulate out-of-context information in user prompts by identifying and reformulating out- of-content information in the context. |
| Outcome: | The proposed framework can achieve strong gains in contextual privacy while preserving the user’s intended interaction goals. |
Similar Papers
Privacy in Action: Towards Realistic Privacy Mitigation and Evaluation for LLM-Powered Agents (2025.findings-emnlp)
Copied to clipboard
Shouju Wang, Fenglin Yu, Xirui Liu, Xiaoting Qin, Jue Zhang, Qingwei Lin, Dongmei Zhang, Saravan Rajmohan
| Challenge: | Existing benchmarks for privacy performance of LLM agents are limited to static, simplified scenarios. |
| Approach: | They propose a model-agnostic, contextual integrity based mitigation approach that effectively reduces privacy leakage from 36.08% to 7.30% on DeepSeek-R1 and from 33.06% to 8.32% on GPT-4o. |
| Outcome: | The proposed approach reduces privacy leakage from 36.08% to 7.30% on DeepSeek-R1 and from 33.06% to 8.32% on GPT-4o while preserving task helpfulness. |
ConVerse: Benchmarking Contextual Safety in Agent-to-Agent Conversations (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are rapidly transitioning from passive text generators to autonomous agents that act and communicate on behalf of users. |
| Approach: | a new benchmark evaluates privacy and security risks in agent–agent interactions . a converse model enables attackers to embed malicious requests within plausible discourse . the model is based on a three-tier taxonomy assessing abstraction quality . |
| Outcome: | ConVerse tests privacy and security risks in agent–agent interactions with 12 user personas and over 864 contextually grounded attacks. |
LLMs are Privacy Erasable (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new study examines the privacy of large language models and their capabilities . the study aims to address the balance between the convenience of LLMs and user privacy concerns . |
| Approach: | They propose a strategy that safeguards user prompt while accessing LLM cloud services . they evaluate the efficacy of their method across prominent LLM benchmarks . |
| Outcome: | The proposed method thwarts reconstruction attacks and improves model performance . it also surpasses the results reported in official model cards . |
SharedRequest: Privacy-Preserving Model-Agnostic Inference for Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing privacy-preserving inference methods sacrifice utility or efficiency, authors say . current approaches suffer a trilemma between privacy, utility, and efficiency, they say . |
| Approach: | They propose a model-agnostic framework for privacy-preserving LLM inference that reformulates privacy protection at the batch level rather than the individual-prompt level. |
| Outcome: | The proposed model-agnostic framework achieves 20% higher utility than previous models . it reduces query cost by up to 5 compared to non-batched inference . |
Can a Large Language Model Keep My Secrets? A Study on LLM-Controlled Agents (2025.acl-srw)
Copied to clipboard
| Challenge: | Using large language models, agents can assist with natural language tasks when given access to confidential data. |
| Approach: | They created a synthetic dataset consisting of confidentiality-aware planning and deduction tasks in organizational access control. |
| Outcome: | The proposed model can perform tasks similar to humans when given access to confidential data. |
Large Language Models Can Be Contextual Privacy Protection Learners (2024.emnlp-main)
Copied to clipboard
Yijia Xiao, Yiqiao Jin, Yushi Bai, Yue Wu, Xianjun Yang, Xiao Luo, Wenchao Yu, Xujiang Zhao, Yanchi Liu, Quanquan Gu, Haifeng Chen, Wei Wang, Wei Cheng
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable linguistic comprehension and generation capability, but when applied to specialized industries, they face challenges such as hallucination, insufficient domain knowledge, and failing to incorporate the latest domain knowledge. |
| Approach: | They propose a paradigm for fine-tuning LLMs that effectively injects domain-specific knowledge while safeguarding inference-time data privacy. |
| Outcome: | The proposed model protects private data while enhancing the model's knowledge. |
Keep Security! Benchmarking Security Policy Preservation in Large Language Model Contexts Against Indirect Attacks in Question Answering (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly deployed in sensitive domains . large-scale benchmarks for contextual security preservation against attacks remain lacking . |
| Approach: | They evaluate 10 Large Language Models on a benchmark dataset to assess their adherence to contextual non-disclosure policies. |
| Outcome: | The proposed model fails to adhere to user-defined security policies in question answering . the model fails in indirect attacks, especially when it violates user-definable policies . |
Controlling What You Share: Assessing Language Model Adherence to Privacy Preferences (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are accessed via commercial APIs, but expose data to service providers. |
| Approach: | They propose a framework where a local model uses natural language instructions to rewrite queries and paired them with synthetic privacy profiles to achieve better privacy preservation. |
| Outcome: | The proposed model outperforms large-scale few-shot models in terms of privacy preservation and performance. |
Privacy-R1: Privacy-Aware Multi-LLM Agent Collaboration via Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Prior approaches to rewriting large language models shatters linguistic coherence and removes privacy-sensitive information. |
| Approach: | They propose a framework that trains an agent to dynamically route text chunks . it implicitly distinguishes between replaceable Personally Identifiable Information (PII) and task-critical PII . |
| Outcome: | The proposed framework achieves state-of-the-art on the privacy-utility frontier . it trains an agent to dynamically route text chunks, learning a policy that balances privacy leakage and task performance. |
Spoken Conversational Agents with Large Language Models (2025.emnlp-tutorials)
Copied to clipboard
| Challenge: | This tutorial focuses on the evolution of voice-native LLMs . it reviews the adaptation of text LLM to audio, cross-modal alignment, and joint speech–text training . |
| Approach: | This tutorial examines the evolution of voice-native LLMs in conversational agents . it compares cascaded and voice-based LLM systems to end-to-end retrieval-and vision-grounded systems . |
| Outcome: | This tutorial examines the evolution of voice-native LLMs . it compares the performance of voice assistants to current open-domain agents . |