GoldCoin: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theory (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing research studies privacy by exploring various privacy attacks, defenses, and evaluations within narrowly predefined patterns. |
| Approach: | They propose a framework that leverages the theory of contextual integrity as a bridge to help LLMs understand the complex contexts for judicial assessing privacy violations. |
| Outcome: | The proposed framework bridges the theory of contextual integrity as a bridge, creating numerous synthetic scenarios grounded in relevant privacy statutes (e.g., HIPAA). |
Similar Papers
PrivaCI-Bench: Evaluating Privacy with Contextual Integrity and Legal Compliance (2025.acl-long)
Copied to clipboard
Haoran Li, Wenbin Hu, Huihao Jing, Yulin Chen, Qi Hu, Sirui Han, Tianshu Chu, Peizhao Hu, Yangqiu Song
| Challenge: | Recent advances in generative large language models (LLMs) have enabled wider applicability, accessibility, and flexibility. |
| Approach: | They propose a contextual privacy evaluation benchmark that covers the entire relevant social context through private information flows. |
| Outcome: | The proposed benchmarks cover legal compliance, real court cases, privacy policies, and synthetic data. |
ContextLens: Modeling Imperfect Privacy and Safety Context for Legal Compliance (2026.acl-long)
Copied to clipboard
Haoran Li, Yulin Chen, Huihao Jing, Wenbin Hu, Tsz Ho Li, Chanhou Lou, Hong Ting Tsang, Sirui Han, Yangqiu Song
| Challenge: | Existing approaches to contextualize safety and privacy assessments assume the availability of complete and clear context, whereas real-world contexts tend to be ambiguous and incomplete. |
| Approach: | They propose a semi-rule-based framework that leverages large language models to ground the input context in the legal domain and explicitly identify both known and unknown factors for legal compliance. |
| Outcome: | The proposed framework can significantly improve existing baselines without training and can identify the ambiguous and missing factors. |
Privacy Checklist: Privacy Violation Detection Grounding on Contextual Integrity Theory (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing privacy studies focus on sub-fields, but they focus on a few sub-domains. |
| Approach: | They propose to use the Health Insurance Portability and Accountability Act of 1996 as an example to develop a checklist that covers social identities, private attributes, and existing privacy regulations. |
| Outcome: | The proposed checklist covers social identities, private attributes, and existing privacy regulations. |
Combating Security and Privacy Issues in the Era of Large Language Models (2024.naacl-tutorials)
Copied to clipboard
| Challenge: | a tutorial aims to provide a summary of risks and vulnerabilities in large language models . a number of studies have focused on security, privacy and copyright aspects of LLMs . |
| Approach: | This tutorial seeks to provide a systematic summary of risks and vulnerabilities in large language models . authors will discuss security, privacy and copyright aspects of LLMs . |
| Outcome: | This tutorial aims to provide a systematic summary of risks and vulnerabilities in large language models . it will also outline emerging challenges in security, privacy and reliability of LLMs . |
Large Language Models Can Be Contextual Privacy Protection Learners (2024.emnlp-main)
Copied to clipboard
Yijia Xiao, Yiqiao Jin, Yushi Bai, Yue Wu, Xianjun Yang, Xiao Luo, Wenchao Yu, Xujiang Zhao, Yanchi Liu, Quanquan Gu, Haifeng Chen, Wei Wang, Wei Cheng
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable linguistic comprehension and generation capability, but when applied to specialized industries, they face challenges such as hallucination, insufficient domain knowledge, and failing to incorporate the latest domain knowledge. |
| Approach: | They propose a paradigm for fine-tuning LLMs that effectively injects domain-specific knowledge while safeguarding inference-time data privacy. |
| Outcome: | The proposed model protects private data while enhancing the model's knowledge. |
Context Reasoner: Incentivizing Reasoning Capability for Contextualized Privacy and Safety Compliance via Reinforcement Learning (2025.emnlp-main)
Copied to clipboard
Wenbin Hu, Haoran Li, Huihao Jing, Qi Hu, Ziqian Zeng, Sirui Han, Xu Heli, Tianshu Chu, Peizhao Hu, Yangqiu Song
| Challenge: | Current mitigation strategies fail to preserve contextual reasoning capabilities in risky scenarios, leading to systemic risks for legal compliance. |
| Approach: | They propose to use reinforcement learning with a rule-based reward to incentivize contextual reasoning capabilities while enhancing compliance with safety and privacy norms. |
| Outcome: | The proposed model outperforms Qwen2.5-7B-Instruct model in safety and privacy benchmarks and achieves +8.58% accuracy improvement. |
Towards Operationalizing Right to Data Protection (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent work introduces the concept of generating unlearnable datasets (by adding imperceptible spurious correlations to the clean data) this approach is limited by several practical constraints like requiring knowledge of the target model. |
| Approach: | They propose a framework that injects imperceptible spurious correlations into natural language datasets, rendering them unlearnable without affecting semantic content. |
| Outcome: | The proposed framework can restrict newer models like GPT-4o and Llama from learning on generated data, resulting in a drop in test accuracy compared to their zero-shot performance. |
Quantifying Association Capabilities of Large Language Models and Its Implications on Privacy Leakage (2024.findings-eacl)
Copied to clipboard
| Challenge: | a new study examines the association capabilities of large language models . as models scale up, their ability to associate entities/information intensifies . however, there is a performance gap when associating commonsense knowledge versus PII, with the latter showing lower accuracy. |
| Approach: | They examine the association capabilities of large language models and identify factors that influence their proficiency in associating information. |
| Outcome: | The proposed models show a performance gap when associating commonsense knowledge versus PII, with the latter showing lower accuracy. |
PIG: Privacy Jailbreak Attack on LLMs via Gradient-based Iterative In-Context Optimization (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods to evaluate privacy leakage in LLMs use memorized prefixes or simple instructions to extract data, which well-aligned models can easily block. |
| Approach: | They propose a framework targeting Personally Identifiable Information (PII) that uses in-context learning to build a privacy context and iteratively updates it with three gradient-based strategies to elicit target PII. |
| Outcome: | The proposed framework outperforms baseline methods and achieves state-of-the-art (SoTA) results on four white-box and two black-box LLMs. |
Nine Ways to Break Copyright Law and Why Our LLM Won’t: A Fair Use Aligned Generation Framework (2025.findings-emnlp)
Copied to clipboard
Aakash Sen Sharma, Debdeep Sanyal, Priyansh Srivastava, Sundar Athreya H, Shirish Karande, Mohan Kankanhalli, Murari Mandal
| Challenge: | Large language models (LLMs) often risk copyright infringement by reproducing protected content verbatim or with insufficient transformative modifications. |
| Approach: | They propose a legally-grounded framework to align LLM outputs with fair-use doctrine . LAW-LM uses a dataset containing 18,000 expert-validated examples . |
| Outcome: | The proposed framework aligns outputs with fair-use doctrine and is validated by 18,000 experts. |