UMMF: Protecting Copyright of Large Vision-Language Models through Unlearning-based Multimodal Memorization Fingerprint (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fingerprinting large vision-Language Models rely on explicit triggers, which have limitations in terms of stealthiness and robustness. |
| Approach: | They propose to use model fingerprints to verify the ownership of large vision-Language Models (LVLMs) they use implicit model fingerprinting techniques that leverage neighboring samples as implicit model . |
| Outcome: | The proposed fingerprinting technique is superior to existing methods, but has limitations in terms of stealthiness and robustness. |
Similar Papers
SUA: Stealthy Multimodal Large Language Model Unlearning Attack (2025.emnlp-main)
Copied to clipboard
| Challenge: | Multimodal Large Language Models (MLLMs) trained on massive data may memorize sensitive personal information and photos, posing privacy and copyright concerns. |
| Approach: | They propose a framework that learns a universal noise pattern to recover unlearned information from MLLMs. |
| Outcome: | The proposed framework learns a universal noise pattern and can reveal unlearned content when applied to images. |
ImF: Embedding an Implicit Fingerprint in Your Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Training and serving large language models (LLMs) is resource-intensive, making reliable intellectual property protection and black-box ownership verification increasingly important. |
| Approach: | They propose a method to inject a small set of secret query–response behaviors into model fingerprinting . they encode ownership information into a natural-looking target response and derive a semantically aligned query . |
| Outcome: | The proposed fingerprints improve stealthiness and remain verifiable under model updates and deployment-time prompt interventions. |
EverTracer: Hunting Stolen Large Language Models via Stealthy and Robust Probabilistic Fingerprint (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing fingerprinting methods require impractical white-box access or introduce detectable statistical anomalies. |
| Approach: | They propose a gray-box fingerprinting framework that ensures stealthy and robust model provenance tracing. |
| Outcome: | The proposed framework is the first to repurpose Membership Inference Attacks (MIAs) for defensive use, embedding ownership signals via memorization instead of artificial trigger-output overfitting. |
Instructional Fingerprinting of Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) require considerable cost to train from scratch . fingerprinting is essential to protect intellectual property and to ensure downstream users and developers adhere to their license terms. |
| Approach: | They propose a method for fingerprinting Large language models that implants a private key into the model to generate specific text when the key is present. |
| Outcome: | The proposed method prevents publisher overclaim and maintains robustness against fingerprint guessing and parameter-efficient training. |
Ghost in the Shell: Synonym-Aware Logit Shaping Fingerprint for Copyright Protection of Large Vision-Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing fingerprinting methods for large vision-language models rely on backdoors to elicit abnormal outputs, but direct distortion of the model’s original outputs compromises modality alignment and degrades multimodal capabilities. |
| Approach: | They propose to embed a robust fingerprint while preserving the original normal outputs of the model. |
| Outcome: | The proposed fingerprint maintains multimodal performance and substantially enhances fingerprint robustness. |
Before Forgetting, Learn to Remember: Revisiting Foundational Learning Failures in LVLM Unlearning Benchmarks (2026.findings-acl)
Copied to clipboard
| Challenge: | Large Vision-Language Models (LVLMs) are capable of learning from vast webscale datasets but pose privacy risks as they can unintentionally memorize sensitive information. |
| Approach: | They propose a Reliable Multi-hop and Multi-image Memorization Benchmark that ensures robust foundational learning through principled data scaling and reasoning-aware QA pairs. |
| Outcome: | Extensive experiments show that ReMem provides a reliable framework for diagnosing both learning and unlearning behaviors in Large Vision-Language Models. |
Tokens for Learning, Tokens for Unlearning: Mitigating Membership Inference Attacks in Large Language Models via Dual-Purpose Training (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing defenses for large language models do not account for the sequential nature of text data. |
| Approach: | They propose a lightweight yet effective empirical privacy defense that leverages token-specific characteristics to protect training data of large language models. |
| Outcome: | The proposed approach provides strong protection against membership inference attacks and improves language modeling performance by 10% across different LLM architectures and datasets compared to baselines. |
MergePrint: Merge-Resistant Fingerprints for Robust Black-box Ownership Verification of Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Model merging introduces a novel risk of unauthorized use of large language models due to the high cost of training. |
| Approach: | They propose a model merging method that embeds robust fingerprints into models . they aim to protect LLMs from misappropriation via model merg and model theft . |
| Outcome: | The proposed method enables black-box ownership verification without accessing model weights or intermediate outputs. |
Black-Box Membership Inference Attacks for Video Training Data in Multimodal Large Language Models (2026.acl-long)
Copied to clipboard
Jinrui Wang, Zhenfeng Gao, Wendan Wang, Huili Wang, Zichen Qin, Linjie Zhu, Hongke Fu, Shangguang Wang, Tao Qi
| Challenge: | Existing methods assess model memorization of key semantic concepts within a video but do not provide reliable evidence that a specific video was used during training. |
| Approach: | They propose a black-box MIA framework that can provide reliable evidence of specific video data usage for training multimodal large language models. |
| Outcome: | The proposed framework can provide reliable evidence of specific video data usage for training multimodal large language models. |
Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench (2025.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) and Multimodal Large Language models (MLLMs) trained on vast web corpora can memorize and disclose individuals’ confidential and private data, raising legal and ethical concerns. |
| Approach: | They propose a benchmark to assess unlearning algorithms from multiple perspectives and provide a baseline for existing generative models. |
| Outcome: | The proposed benchmark consists of 500 fictitious profiles and 153 profiles for public celebrities, evaluated from both multimodal (image+text) and unimodal (text) perspectives. |