Challenge: Existing methods for text watermarking rely on arbitrary vocabulary partitioning during decoding, which compromises the availability of suitable tokens and significantly degrades the quality of responses.
Approach: They propose a method that leverages linguistic prior knowledge of lexical redundancies in LLM vocabularies to seamlessly integrate watermarks.
Outcome: The proposed approach preserves the expressive power of large language models while preserving watermark detectability.

Similar Papers

Subtle Signatures, Strong Shields: Advancing Robust and Imperceptible Watermarking in Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have led to an increase in AI-generated text on the Internet, presenting a crucial challenge to differentiate AI-created content from human-written text.
Approach: They propose a novel approach to embed watermarks into LLMs that leverages token prior probabilities to improve detectability and maintain watermark imperceptibility.
Outcome: The proposed method improves detectability and imperceptibility of watermarks by partitioning tokens into two distinct groups based on prior probabilities and employing tailored strategies for each group.
WaterPool: A Language Model Watermark Mitigating Trade-Offs among Imperceptibility, Efficacy and Robustness (2025.naacl-long)

Copied to clipboard

Challenge: Existing methods to trace the usage of large language models often face trade-offs between imperceptibility and robustness.
Approach: They propose a key-centered scheme to unify existing methods by decomposing a watermark into two components: a 'key module' and a "mark module".
Outcome: The proposed method can be integrated with existing methods and achieve near-optimal imperceptibility and detection efficacy.
Lost in Overlap: Exploring Logit-based Watermark Collision in LLMs (2025.findings-naacl)

Copied to clipboard

Challenge: Existing watermarking methods embed imperceptible identifiers into text to address copyright concerns.
Approach: They propose a new philosophy for watermark attacks that addresses watermark collision . they demonstrate that collision poses a threat to all logit-based watermark algorithms .
Outcome: The proposed method improves watermark collision performance on top of other methods.
From Trade-off to Synergy: A Versatile Symbiotic Watermarking Framework for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing watermarking methods face limitations that hinder their effectiveness in diverse and adversarial scenarios.
Approach: They propose a symbiotic watermarking framework with three strategies: serial, parallel, and hybrid.
Outcome: The proposed framework outperforms baselines and achieves state-of-the-art (SOTA) performance.
WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Recent studies have developed watermarking algorithms which restrict the generation process to leave an invisible trace for watermark detection.
Approach: They propose a benchmarking procedure that compares different methods to ensure consistent watermarking strength and jointly evaluates their generation and detection performance.
Outcome: The proposed benchmark compares 4 open-source watermarks on 2 LLMs under 2 watermarking strengths and observes the common struggles for current methods on maintaining the generation quality.
WaterJudge: Quality-Detection Trade-off when Watermarking Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: Recent work has shown that small, context-dependent shifts in word distributions can be used to apply and detect watermarks, but little work has analyzed the impact of these perturbations on the quality of generated texts.
Approach: They propose a framework that allows for analysis of the impact of watermark settings on the quality of generated texts.
Outcome: The proposed framework provides easy visualization of the quality-detection trade-off of watermark settings.
Robust Data Watermarking in Language Models by Injecting Fictitious Knowledge (2025.findings-acl)

Copied to clipboard

Challenge: Data watermarking in language models injects traceable signals, such as specific token sequences or stylistic patterns, into copyrighted text, allowing copyright holders to track and verify training data ownership.
Approach: They propose a data watermarking approach that injects coherent and plausible yet fictitious knowledge into training data using generated passages describing a fictious entity and its associated attributes.
Outcome: The proposed method is designed to be memorized by the LLM, and that increasing their density, length, and diversity of attributes strengthens their memorization.
Topic-Based Watermarks for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing watermarking methods often involve trade-offs between attack robustness, generation quality and additional overhead.
Approach: They propose a topic-guided watermarking scheme that partitions the vocabulary into topic-aligned token subsets.
Outcome: The proposed method achieves text quality comparable to industry-leading systems and improves watermark robustness against paraphrasing and lexical perturbation attacks with minimal performance overhead.
A Linguistics-Aware LLM Watermarking via Syntactic Predictability (2026.acl-long)

Copied to clipboard

Challenge: a central challenge remains balancing text quality against detection robustness.
Approach: They propose a framework that aligns watermark strength with linguistic degrees of freedom . they use part-of-speech models to weaken the signal in grammatically constrained contexts .
Outcome: The proposed framework outperforms existing methods in linguistic indeterminacy tests on languages . it weakens the watermark strength in grammatically constrained contexts and strengthens it in contexts with greater linguistic flexibility.
MarkLLM: An Open-Source Toolkit for LLM Watermarking (2024.emnlp-demo)

Copied to clipboard

Challenge: Large Language Models (LLMs) embed imperceptible yet algorithmically detectable signals in outputs to identify LLM-generated text.
Approach: They propose to develop an open-source toolkit for LLM watermarking that embeds imperceptible yet algorithmically detectable signals in model outputs to identify LLM-generated text.
Outcome: MarkLLM provides a unified framework for implementing LLM watermarking algorithms, while providing user-friendly interfaces to ensure ease of access.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations