Challenge: Existing methods for detecting and monitoring generated text face a trade-off between the quality of the generated text and the effectiveness of the watermarking process.
Approach: They propose a new type of LLM watermark, Sparse WatermARK, which uses watermarks to a small subset of generated tokens distributed across the text.
Outcome: The proposed method outperforms existing methods in detectability and quality while maintaining generated text quality.

Similar Papers

Subtle Signatures, Strong Shields: Advancing Robust and Imperceptible Watermarking in Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have led to an increase in AI-generated text on the Internet, presenting a crucial challenge to differentiate AI-created content from human-written text.
Approach: They propose a novel approach to embed watermarks into LLMs that leverages token prior probabilities to improve detectability and maintain watermark imperceptibility.
Outcome: The proposed method improves detectability and imperceptibility of watermarks by partitioning tokens into two distinct groups based on prior probabilities and employing tailored strategies for each group.
Topic-Based Watermarks for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing watermarking methods often involve trade-offs between attack robustness, generation quality and additional overhead.
Approach: They propose a topic-guided watermarking scheme that partitions the vocabulary into topic-aligned token subsets.
Outcome: The proposed method achieves text quality comparable to industry-leading systems and improves watermark robustness against paraphrasing and lexical perturbation attacks with minimal performance overhead.
Watermarking with Low-Entropy POS-Guided Token Partitioning and Z-Score-Driven Dynamic Bias for Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing watermarking methods reduce the fidelity of semantics in LLMs .
Approach: They propose a low-entropy token partitioning mechanism and z-score-driven dynamic bias mechanism to enhance semantics.
Outcome: The proposed framework improves semantic fidelity and robustness against bias sparsity attacks.
PostMark: A Robust Blackbox Watermark for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to detect LLM-generated text require access to the underlying LLM’s logits, which LLM providers are loath to share due to fears of model distillation.
Approach: They develop a post-hoc watermarking procedure that inserts an input-dependent set of words into the text after the decoding process has completed.
Outcome: The proposed method is more robust to paraphrasing attacks than existing methods.
MarkLLM: An Open-Source Toolkit for LLM Watermarking (2024.emnlp-demo)

Copied to clipboard

Challenge: Large Language Models (LLMs) embed imperceptible yet algorithmically detectable signals in outputs to identify LLM-generated text.
Approach: They propose to develop an open-source toolkit for LLM watermarking that embeds imperceptible yet algorithmically detectable signals in model outputs to identify LLM-generated text.
Outcome: MarkLLM provides a unified framework for implementing LLM watermarking algorithms, while providing user-friendly interfaces to ensure ease of access.
Marking Code Without Breaking It: Code Watermarking for Detecting LLM-Generated Code (2026.findings-eacl)

Copied to clipboard

Challenge: Existing methods for identifying LLM-generated code are limited by syntax-critical tokens, which can introduce syntax errors.
Approach: They propose a syntax-aware watermarking method that embeds watermarks only in non-syntactic tokens and preserves code integrity.
Outcome: The proposed method outperforms baseline methods on Python, C++, and Java.
Watermark under Fire: A Robustness Evaluation of LLM Watermarking (2025.findings-emnlp)

Copied to clipboard

Challenge: Various watermarking methods have been proposed to identify LLM-generated texts . lack of unified evaluation platforms has left many critical questions unanswered .
Approach: They systematize existing LLM watermarkers and watermark removal attacks and develop a unified platform that integrates them.
Outcome: The proposed systematizes existing LLM watermarkers and watermark removal attacks, mapping out their design spaces.
WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Recent studies have developed watermarking algorithms which restrict the generation process to leave an invisible trace for watermark detection.
Approach: They propose a benchmarking procedure that compares different methods to ensure consistent watermarking strength and jointly evaluates their generation and detection performance.
Outcome: The proposed benchmark compares 4 open-source watermarks on 2 LLMs under 2 watermarking strengths and observes the common struggles for current methods on maintaining the generation quality.
Where Am I From? Identifying Origin of LLM-generated Content (2024.emnlp-main)

Copied to clipboard

Challenge: Generative models have produced high-quality content, but they pose security risks . a new framework for deep learning systems enables the tracing of AI-generated content back to its source .
Approach: They propose a digital forensics framework that embeds a secret watermark into the generated output and a "depth watermark" this watermark strengthens the link between content and generator, enabling accurate tracing while maintaining the quality of the generated content.
Outcome: The proposed framework ensures accurate tracing while maintaining quality of generated content.
Robust Data Watermarking in Language Models by Injecting Fictitious Knowledge (2025.findings-acl)

Copied to clipboard

Challenge: Data watermarking in language models injects traceable signals, such as specific token sequences or stylistic patterns, into copyrighted text, allowing copyright holders to track and verify training data ownership.
Approach: They propose a data watermarking approach that injects coherent and plausible yet fictitious knowledge into training data using generated passages describing a fictious entity and its associated attributes.
Outcome: The proposed method is designed to be memorized by the LLM, and that increasing their density, length, and diversity of attributes strengthens their memorization.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations