Challenge: Existing models do not detect PII in user prompts, despite their convenience . current models show significant limitations in determining PI I query relevance .
Approach: They propose a query-unrelated PII masking strategy and propose PIi-Bench . they propose 'quick-and-easy' PI I masking with a user query and context description .
Outcome: The proposed model performs well in basic PII detection, but shows significant limitations in query relevance.

Similar Papers

PII-VisBench: Evaluating Personally Identifiable Information Safety in Vision Language Models Along a Continuum of Visibility (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluations of PII leakage ignore how a subject’s online presence affects privacy alignment.
Approach: They propose a benchmark that evaluates safety through the continuum of online presence by stratifying 200 subjects into four visibility categories: high, medium, low, and zero.
Outcome: The proposed model stratifies 200 subjects into four visibility categories based on the extent and nature of their information available online.
CAPID: Context-Aware PII Detection for Question-Answering Systems (2026.eacl-srw)

Copied to clipboard

Challenge: Existing approaches mainly redact all PII, disregarding the fact that some may be contextually relevant to the user’s question, resulting in a degradation of response quality.
Approach: They propose a method that fine-tunes a locally owned small language model that filters sensitive information before it is passed to LLMs for QA.
Outcome: The proposed approach outperforms baselines in span, relevance and type accuracy while preserving significantly higher utility under anonymization.
PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models (2024.acl-long)

Copied to clipboard

Challenge: generative large language models (LLMs) exhibit surprising capability and integrate previous tasks into a unified text generation formulation.
Approach: They propose a privacy evaluation benchmark to quantify the privacy leakage of language models.
Outcome: The proposed benchmark compares PPLMs with different privacy implementations to find out how privacy leakage is handled.
PrivaCI-Bench: Evaluating Privacy with Contextual Integrity and Legal Compliance (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in generative large language models (LLMs) have enabled wider applicability, accessibility, and flexibility.
Approach: They propose a contextual privacy evaluation benchmark that covers the entire relevant social context through private information flows.
Outcome: The proposed benchmarks cover legal compliance, real court cases, privacy policies, and synthetic data.
PAPILLON: Privacy Preservation from Internet-based and Local Language Model Ensembles (2025.naacl-long)

Copied to clipboard

Challenge: Existing research has studied privacy in LLM training data memorization, but it does not prevent users from disclosing PII at inference time.
Approach: They propose a task for chaining API-based and local LLMs that uses public data to construct a benchmark that contains personally identifiable information (PII)
Outcome: The proposed model maintains high response quality for 85.5% of user queries while restricting privacy leakage to only 7.5%.
Privacy Evaluation Benchmarks for NLP Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Several kinds of privacy attacks are studied in depth, but they are non-systematic and lack a comprehensive understanding of the impact caused by the attacks.
Approach: They propose a privacy attack and defense evaluation benchmark in the field of NLP . they propose an improved attack method and a chained framework for privacy attacks .
Outcome: The proposed framework can be chained to achieve a higher-level attack objective.
SPY: Enhancing Privacy with Synthetic PII Detection Dataset (2025.naacl-srw)

Copied to clipboard

Challenge: Historically, Named Entity Recognition (NER) has been employed for PII detection, but PI I entities constitute a subset of NER entities.
Approach: They propose to use Large Language Models to generate a synthetic dataset that emulates real-world PII scenarios and validate its quality.
Outcome: The proposed dataset is validated and provides a benchmark for PII detection.
Subject-level Inference for Realistic Text Anonymization Evaluation (2026.acl-long)

Copied to clipboard

Challenge: Existing text anonymization evaluations assume only a single data subject, ignoring multi-subject scenarios.
Approach: They propose a benchmark that shifts the unit of evaluation from text spans to individuals . they show that subject-level inference protection drops as low as 33% when masked .
Outcome: The proposed benchmark reduces the amount of protection available when PII spans are masked.
User Perceptions vs. Proxy LLM Judges: Privacy and Helpfulness in LLM Responses to Privacy-Sensitive Scenarios (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) are rapidly being adopted for tasks like drafting emails, summarizing meetings, and answering health questions.
Approach: They conducted a scenario-based evaluation of Large language models (LLMs) using 90 PrivacyLens scenarios.
Outcome: The proposed models can leak private information in complex scenarios, but they do not measure user perceptions directly.
PIIvot: A Lightweight NLP Anonymization Framework for Question-Anchored Tutoring Dialogues (2025.emnlp-main)

Copied to clipboard

Challenge: Understanding and improving affective learning strategies continues to be one of computing's primary contributions to education research.
Approach: They propose a framework for PII anonymization that leverages knowledge of the data context to simplify the PI I detection problem.
Outcome: The proposed framework simplifies the detection problem by leveraging knowledge of the data context.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations