Challenge: Recent studies show that de-identification is effective in the clinical domain but not in the downstream tasks.
Approach: They propose a stacked model with restricted access to privacy sensitive information and a multitask model to investigate the effect of de-identification on clinical concept extraction.
Outcome: The proposed model is stacked with restricted access to privacy sensitive information and a multitask model.

Similar Papers

Clinical Text Anonymization, its Influence on Downstream NLP Tasks and the Risk of Re-Identification (2023.eacl-srw)

Copied to clipboard

Challenge: De-identification and anonymization of clinical data is needed to solve access to clinicaldata.
Approach: They propose to use text anonymization techniques to break the anonymization of clinical data . they propose to apply a re-identification attack to the anonymized text data to break this.
Outcome: The proposed approach can break the anonymization of clinical data, the authors show .
Data-Constrained Synthesis of Training Data for De-Identification (2025.acl-long)

Copied to clipboard

Challenge: sensitive domains lack widely available datasets due to privacy risks . recent studies have focused on evaluating the privacy of the synthetic text .
Approach: They domain-adapt LLMs to clinical domain and generate synthetic clinical texts . they then generate NER models that can be annotated with tags for PII .
Outcome: The proposed model performs better than the original model using smaller datasets.
Not What the Doctor Ordered: Surveying LLM-based De-identification and Quantifying Clinical Information Loss (2025.emnlp-main)

Copied to clipboard

Challenge: De-identification is an application of NLP where automated algorithms remove identifying information of patients and providers.
Approach: They propose to use generative large language models to de-identify patients and providers . they propose to validate existing metrics to quantify extent of inappropriate removal .
Outcome: The proposed method is based on a survey of LLM-based de-identification research . it shows that the models perform poorly in identifying clinically relevant changes .
Adversarial Learning of Privacy-Preserving Text Representations for De-Identification of Medical Records (P19-1)

Copied to clipboard

Challenge: De-identification is the task of detecting protected health information (PHI) in medical text.
Approach: They propose to create shareable representations of medical text that contain no PHI and can be shared between organizations to create unified datasets for training de-identification models.
Outcome: The proposed representation allows training a simple LSTM-CRF model to an F1 score of 97.4%.
Incorporating medical knowledge in BERT for clinical relation extraction (2021.emnlp-main)

Copied to clipboard

Challenge: Pre-trained language models (PLMs) are used for diverse NLP tasks such as Information Extraction, Sentiment Analysis and Question/Answering.
Approach: They propose to add medical knowledge to pre-trained language models to facilitate clinical relation extraction using a large text corpus.
Outcome: The proposed model outperforms the state-of-the-art systems on the benchmark i2b2/VA 2010 clinical relation extraction dataset.
Downstream Task Performance of BERT Models Pre-Trained Using Automatically De-Identified Clinical Data (2022.lrec-1)

Copied to clipboard

Challenge: Automatic de-identification systems introduce errors due to their imperfect precision and may negatively impact the utility of the de-identified dataset.
Approach: They propose to de-identifie a large clinical corpus in Swedish by removing entire sentences containing sensitive data or by replacing sensitive words with realistic surrogates.
Outcome: The proposed models are safe to distribute to other academic researchers and reduce privacy risks.
Exploring LLM Annotation for Adaptation of Clinical Information Extraction Models under Data-sharing Restrictions (2025.findings-acl)

Copied to clipboard

Challenge: In-hospital text data often contains valuable clinical information, yet fine-tuned small language models (SLMs) for information extraction remain challenging due to differences in formatting and vocabulary across institutions.
Approach: They leverage large language models to annotate the target domain data for adaptation . they use in-hospital text data to extract clinical information .
Outcome: The proposed model outperforms manual annotation on four clinical information extraction tasks with a larger number of annotated data.
Large language models are few-shot clinical information extractors (2022.emnlp-main)

Copied to clipboard

Challenge: a long-running goal of clinical NLP is the extraction of important variables trapped in clinical notes.
Approach: They propose to use large language models to tackle diverse clinical extraction tasks . they propose to reannote existing CASI datasets to compare their models with clinical text.
Outcome: The proposed models outperform existing models on few-shot clinical information extraction tasks.
MedFilter: Improving Extraction of Task-relevant Utterances through Integration of Discourse Structure and Ontological Knowledge (2020.emnlp-main)

Copied to clipboard

Challenge: Identifying task-relevant utterances improves performance at downstream medical processing.
Approach: They propose a novel approach that uses task-oriented conversations to improve utterance classification over SOTA models.
Outcome: The proposed model improves on a corpus of 7,000 doctor-patient conversations on 7,000 patient conversations.
Revisiting De-Identification of Electronic Medical Records: Evaluation of Within- and Cross-Hospital Generalization (2023.emnlp-main)

Copied to clipboard

Challenge: De-identification is a natural language processing task to detect and remove the protected health information (PHI) from electronic medical records (EMRs).
Approach: They propose a de-identification dataset comprising EMRs from three hospitals in China and use it to establish a benchmark for evaluating both within- and cross-hospital generalization.
Outcome: The proposed model with almost perfect within-hospital performance struggles when transferred across hospitals.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations