The Model’s Language Matters: A Comparative Privacy Analysis of LLMs (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models are increasingly deployed in multilingual settings that process sensitive data . prior privacy evaluations focused on English, but new research shows that language matters for privacy leakage . |
| Approach: | They quantify six corpus-level linguistic indicators and evaluate vulnerability under three attack families. |
| Outcome: | The results show that language matters for privacy leakage in large language models . Italian exhibits the strongest exposure, while English and French are more resilient . |
Similar Papers
Quantifying Association Capabilities of Large Language Models and Its Implications on Privacy Leakage (2024.findings-eacl)
Copied to clipboard
| Challenge: | a new study examines the association capabilities of large language models . as models scale up, their ability to associate entities/information intensifies . however, there is a performance gap when associating commonsense knowledge versus PII, with the latter showing lower accuracy. |
| Approach: | They examine the association capabilities of large language models and identify factors that influence their proficiency in associating information. |
| Outcome: | The proposed models show a performance gap when associating commonsense knowledge versus PII, with the latter showing lower accuracy. |
Combating Security and Privacy Issues in the Era of Large Language Models (2024.naacl-tutorials)
Copied to clipboard
| Challenge: | a tutorial aims to provide a summary of risks and vulnerabilities in large language models . a number of studies have focused on security, privacy and copyright aspects of LLMs . |
| Approach: | This tutorial seeks to provide a systematic summary of risks and vulnerabilities in large language models . authors will discuss security, privacy and copyright aspects of LLMs . |
| Outcome: | This tutorial aims to provide a systematic summary of risks and vulnerabilities in large language models . it will also outline emerging challenges in security, privacy and reliability of LLMs . |
The Linguistic Connectivities Within Large Language Models (2025.findings-acl)
Copied to clipboard
Dan Wang, Boxi Cao, Ning Bian, Xuanang Chen, Yaojie Lu, Hongyu Lin, Jia Zheng, Le Sun, Shanshan Jiang, Bin Dong, Xianpei Han
| Challenge: | Recent studies have discovered notable disparities in their performance across different languages. |
| Approach: | They conduct a systematic investigation into the behaviors of large language models across 27 different languages on 3 different scenarios and reveals a Linguistic Map correlates with the richness of available resources and linguistic family relations. |
| Outcome: | The proposed model demonstrates that there are significant disparities in performance across languages across 27 different languages on 3 different scenarios. |
Safety of Large Language Models Beyond English: A Systematic Literature Review of Risks, Biases, and Safeguards (2026.eacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have a growing number of applications that generate harmful, biased, or unsafe content. |
| Approach: | They synthesize findings from recent studies that evaluate their robustness across languages . they highlight gaps in multilingual safety research and recommend future work . |
| Outcome: | The systematic review examines the multilingual safety of large language models in English . it identifies challenges such as dataset availability and evaluation biases . |
Controlling What You Share: Assessing Language Model Adherence to Privacy Preferences (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are accessed via commercial APIs, but expose data to service providers. |
| Approach: | They propose a framework where a local model uses natural language instructions to rewrite queries and paired them with synthetic privacy profiles to achieve better privacy preservation. |
| Outcome: | The proposed model outperforms large-scale few-shot models in terms of privacy preservation and performance. |
SecureSQL: Evaluating Data Leakage of Large Language Models as Natural Language Interfaces to Databases (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on the vulnerability of large language models to SQL injection have been limited. |
| Approach: | They propose to evaluate the potential of language models to leak sensitive data when generating SQL queries. |
| Outcome: | The proposed model with the best performance has an accuracy of 61.7%, compared to humans who achieve 94% accuracy. |
Large Language Models are Easily Confused: A Quantitative Metric, Security Implications and Typological Analysis (2025.findings-naacl)
Copied to clipboard
| Challenge: | Language Confusion is a phenomenon where Large Language Models (LLMs) generate text that is neither in the desired language, nor in a contextually appropriate one. |
| Approach: | They propose a metric to measure and quantify language confusion in Large Language Models (LLMs) they link language confusion to LLM security and find patterns in the case of multilingual embedding inversion attacks. |
| Outcome: | The proposed metric reveals language confusion across LLMs and link it to LLM security and embedding inversion attacks. |
Large Language Models Can Be Contextual Privacy Protection Learners (2024.emnlp-main)
Copied to clipboard
Yijia Xiao, Yiqiao Jin, Yushi Bai, Yue Wu, Xianjun Yang, Xiao Luo, Wenchao Yu, Xujiang Zhao, Yanchi Liu, Quanquan Gu, Haifeng Chen, Wei Wang, Wei Cheng
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable linguistic comprehension and generation capability, but when applied to specialized industries, they face challenges such as hallucination, insufficient domain knowledge, and failing to incorporate the latest domain knowledge. |
| Approach: | They propose a paradigm for fine-tuning LLMs that effectively injects domain-specific knowledge while safeguarding inference-time data privacy. |
| Outcome: | The proposed model protects private data while enhancing the model's knowledge. |
Unveiling Privacy Risks in Multi-modal Large Language Models: Task-specific Vulnerabilities and Mitigation Challenges (2025.findings-acl)
Copied to clipboard
| Challenge: | Privacy risks in text-only Large Language Models are well-documented, especially their tendency to memorize and leak sensitive information. |
| Approach: | They propose a dataset to assess privacy risks across multi-modal tasks and scenarios . they demonstrate how models leak sensitive data across various tasks . |
| Outcome: | The proposed model can leak sensitive data embedded in images or stored in memory, exposing privacy risks. |
Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attacks (2022.emnlp-main)
Copied to clipboard
| Challenge: | Prior attempts at measuring leakage of MLMs via membership inference attacks have been inconclusive, implying potential robustness of Mlms to privacy attacks. |
| Approach: | They propose a stronger membership inference attack based on likelihood ratio hypothesis testing that involves an additional MLM to more accurately quantify the privacy risks of memorization in MLMs. |
| Outcome: | The proposed attack improves the AUC of prior membership inference attacks from 0.66 to an alarmingly high 0.90 level on models trained on medical notes. |