From Intentions to Techniques: A Comprehensive Taxonomy and Challenges in Text Watermarking for Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are rapidly growing and allowing textual content to be protected against unauthorized use. |
| Approach: | They present a unified overview of different perspectives behind designing watermarking techniques through a comprehensive survey of the research literature. |
| Outcome: | The proposed methods are based on the evaluation datasets used and watermarking addition and removal methods to construct a taxonomy. |
Similar Papers
Synthetic Text Detection in the Age of Large Language Models: Watermark vs. Automatic Detection (2026.acl-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are ubiquitous and capable of generating long coherent texts that look almost indistinguishable from human-written texts. |
| Approach: | They propose to use watermark and automatic detection to detect synthetic texts generated from Large Language Models (LLMs) they evaluate six different models, six different watermark techniques and two different automatic detectors for different levels of syntactic changes. |
| Outcome: | The proposed methods outperform on unperturbed and perturbed datasets on six different sizes of Qwen2.5 models, six watermark techniques and detectors, and two automatic detectors. |
Can Watermarks Survive Translation? On the Cross-lingual Consistency of Text Watermark for Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Existing text watermarking technologies lack consistency when texts are translated into different languages. |
| Approach: | They propose a cross-lingual watermark removal attack to bypass watermarking by first obtaining a response from an LLM in a pivot language and then translating it into the target language. |
| Outcome: | The proposed method can remove watermarks without performance loss by obtaining a response from an LLM in a pivot language and then translating it into the target language. |
WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models (2024.acl-long)
Copied to clipboard
| Challenge: | Recent studies have developed watermarking algorithms which restrict the generation process to leave an invisible trace for watermark detection. |
| Approach: | They propose a benchmarking procedure that compares different methods to ensure consistent watermarking strength and jointly evaluates their generation and detection performance. |
| Outcome: | The proposed benchmark compares 4 open-source watermarks on 2 LLMs under 2 watermarking strengths and observes the common struggles for current methods on maintaining the generation quality. |
MarkLLM: An Open-Source Toolkit for LLM Watermarking (2024.emnlp-demo)
Copied to clipboard
Leyi Pan, Aiwei Liu, Zhiwei He, Zitian Gao, Xuandong Zhao, Yijian Lu, Binglin Zhou, Shuliang Liu, Xuming Hu, Lijie Wen, Irwin King, Philip Yu
| Challenge: | Large Language Models (LLMs) embed imperceptible yet algorithmically detectable signals in outputs to identify LLM-generated text. |
| Approach: | They propose to develop an open-source toolkit for LLM watermarking that embeds imperceptible yet algorithmically detectable signals in model outputs to identify LLM-generated text. |
| Outcome: | MarkLLM provides a unified framework for implementing LLM watermarking algorithms, while providing user-friendly interfaces to ensure ease of access. |
Evaluating the Robustness and Accuracy of Text Watermarking Under Real-World Cross-Lingual Manipulations (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a study focuses on evaluating watermarking methods for the English language . the literature for evaluating cross-lingual watermarks is scarce . |
| Approach: | They evaluate representative watermarking methods in four different languages . they examine the quality of text under different watermark procedures . |
| Outcome: | The proposed method is compared with other evaluation methods in four different languages. |
Subtle Signatures, Strong Shields: Advancing Robust and Imperceptible Watermarking in Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have led to an increase in AI-generated text on the Internet, presenting a crucial challenge to differentiate AI-created content from human-written text. |
| Approach: | They propose a novel approach to embed watermarks into LLMs that leverages token prior probabilities to improve detectability and maintain watermark imperceptibility. |
| Outcome: | The proposed method improves detectability and imperceptibility of watermarks by partitioning tokens into two distinct groups based on prior probabilities and employing tailored strategies for each group. |
Revisiting the Robustness of Watermarking to Paraphrasing Attacks (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent watermarking techniques slightly modify the output probabilities of LMs to embed a signal in the generated output that can later be detected. |
| Approach: | They propose to use a model to produce a watermarking signal that is invariant to semantically-similar inputs to undo the effects of watermarks. |
| Outcome: | The proposed method undoes the effects of watermarking and dramatically improves the effectiveness of paraphrasing attacks with limited access to model generations. |
WaterPool: A Language Model Watermark Mitigating Trade-Offs among Imperceptibility, Efficacy and Robustness (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to trace the usage of large language models often face trade-offs between imperceptibility and robustness. |
| Approach: | They propose a key-centered scheme to unify existing methods by decomposing a watermark into two components: a 'key module' and a "mark module". |
| Outcome: | The proposed method can be integrated with existing methods and achieve near-optimal imperceptibility and detection efficacy. |
WASA: WAtermark-based Source Attribution for Large Language Model-Generated Data (2025.findings-acl)
Copied to clipboard
Xinyang Lu, Jingtan Wang, Zitong Zhao, Zhongxiang Dai, Chuan-Sheng Foo, See-Kiong Ng, Bryan Kian Hsiang Low
| Challenge: | Large language models (LLMs) have impressive performance but intellectual property concerns are looming . a framework that can be used to perform source attribution for LLMs can be developed. |
| Approach: | They propose a framework that enables an LLM to generate synthetic texts with embedded watermarks that contain information about their source. |
| Outcome: | The proposed framework achieves source attribution accuracy and robustness against adversaries. |
Watermark under Fire: A Robustness Evaluation of LLM Watermarking (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Various watermarking methods have been proposed to identify LLM-generated texts . lack of unified evaluation platforms has left many critical questions unanswered . |
| Approach: | They systematize existing LLM watermarkers and watermark removal attacks and develop a unified platform that integrates them. |
| Outcome: | The proposed systematizes existing LLM watermarkers and watermark removal attacks, mapping out their design spaces. |