Challenge: Experimental results demonstrate that SimMark surpasses previous sentence-level watermarking techniques in robustness, sampling efficiency, and applicability across diverse domains.
Approach: They propose a sentence-level watermarking algorithm that makes LLM outputs traceable without requiring access to model internals.
Outcome: The proposed algorithm surpasses previous sentence-level watermarking techniques in robustness, sampling efficiency, and applicability across diverse domains while maintaining the text quality and fluency.

Similar Papers

PostMark: A Robust Blackbox Watermark for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to detect LLM-generated text require access to the underlying LLM’s logits, which LLM providers are loath to share due to fears of model distillation.
Approach: They develop a post-hoc watermarking procedure that inserts an input-dependent set of words into the text after the decoding process has completed.
Outcome: The proposed method is more robust to paraphrasing attacks than existing methods.
Topic-Based Watermarks for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing watermarking methods often involve trade-offs between attack robustness, generation quality and additional overhead.
Approach: They propose a topic-guided watermarking scheme that partitions the vocabulary into topic-aligned token subsets.
Outcome: The proposed method achieves text quality comparable to industry-leading systems and improves watermark robustness against paraphrasing and lexical perturbation attacks with minimal performance overhead.
A Robust Semantics-based Watermark for Large Language Model against Paraphrasing (2024.findings-naacl)

Copied to clipboard

Challenge: Existing methods to detect LLM-generated content use simple hashes of precedent tokens to partition vocabulary.
Approach: They propose a semantics-based watermark framework to enhance the robustness against paraphrase.
Outcome: The proposed framework is robust under different paraphrases and the semantic meaning of the sentences will be likely preserved under paraphrase.
Subtle Signatures, Strong Shields: Advancing Robust and Imperceptible Watermarking in Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have led to an increase in AI-generated text on the Internet, presenting a crucial challenge to differentiate AI-created content from human-written text.
Approach: They propose a novel approach to embed watermarks into LLMs that leverages token prior probabilities to improve detectability and maintain watermark imperceptibility.
Outcome: The proposed method improves detectability and imperceptibility of watermarks by partitioning tokens into two distinct groups based on prior probabilities and employing tailored strategies for each group.
Revisiting the Robustness of Watermarking to Paraphrasing Attacks (2024.emnlp-main)

Copied to clipboard

Challenge: Recent watermarking techniques slightly modify the output probabilities of LMs to embed a signal in the generated output that can later be detected.
Approach: They propose to use a model to produce a watermarking signal that is invariant to semantically-similar inputs to undo the effects of watermarks.
Outcome: The proposed method undoes the effects of watermarking and dramatically improves the effectiveness of paraphrasing attacks with limited access to model generations.
XMark: Reliable Multi-Bit Watermarking for LLM-Generated Texts (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for embedding binary messages into LLM-generated text suffer from key limitations, such as a poor trade-off between text quality and decoding accuracy.
Approach: They propose a method for embedding binary messages into Large Language Model (LLM)-generated text that uses a limited number of tokens to decode and recover the encoded message.
Outcome: The proposed method significantly outperforms existing methods in multiple downstream tasks and will be made publicly available upon acceptance.
Improved Unbiased Watermark for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Unbiased watermarks allow to distinguish between text generated by humans and machines without causing distortion.
Approach: They introduce a family of unbiased, Multi-Channel-based watermarks that partition the language model into segments and promote token probabilities within a selected segment based on a watermark key.
Outcome: The proposed watermarks preserve the original distribution of the language model and offer significant improvements in detectability and robustness over existing unbiased watermark systems.
Robust Data Watermarking in Language Models by Injecting Fictitious Knowledge (2025.findings-acl)

Copied to clipboard

Challenge: Data watermarking in language models injects traceable signals, such as specific token sequences or stylistic patterns, into copyrighted text, allowing copyright holders to track and verify training data ownership.
Approach: They propose a data watermarking approach that injects coherent and plausible yet fictitious knowledge into training data using generated passages describing a fictious entity and its associated attributes.
Outcome: The proposed method is designed to be memorized by the LLM, and that increasing their density, length, and diversity of attributes strengthens their memorization.
Where Am I From? Identifying Origin of LLM-generated Content (2024.emnlp-main)

Copied to clipboard

Challenge: Generative models have produced high-quality content, but they pose security risks . a new framework for deep learning systems enables the tracing of AI-generated content back to its source .
Approach: They propose a digital forensics framework that embeds a secret watermark into the generated output and a "depth watermark" this watermark strengthens the link between content and generator, enabling accurate tracing while maintaining the quality of the generated content.
Outcome: The proposed framework ensures accurate tracing while maintaining quality of generated content.
SemStamp: A Semantic Watermark with Paraphrastic Robustness for Text Generation (2024.naacl-long)

Copied to clipboard

Challenge: Existing watermarked generation algorithms employ token-level designs and are vulnerable to paraphrase attacks.
Approach: They propose a sentence-level watermarking algorithm that uses locality-sensitive hashing to partition the semantic space of sentences.
Outcome: The proposed algorithm is more robust than the existing state-of-the-art method on paraphrasers and domains, while posing only minor degradations to SemStamp.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations