Challenge: Large Language Models (LLMs) have led to an increase in AI-generated text on the Internet, presenting a crucial challenge to differentiate AI-created content from human-written text.
Approach: They propose a novel approach to embed watermarks into LLMs that leverages token prior probabilities to improve detectability and maintain watermark imperceptibility.
Outcome: The proposed method improves detectability and imperceptibility of watermarks by partitioning tokens into two distinct groups based on prior probabilities and employing tailored strategies for each group.

Similar Papers

Watermarking Large Language Models: An Unbiased and Low-risk Method (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have highlighted the risk of misusing them, raising the need for accurate detection of LLM-generated content.
Approach: They propose a method to inject imperceptible identifiers into large language models (LLMs) this method is unbiased and preserves the original token distribution in expectation .
Outcome: The proposed method preserves the original token distribution in expectation and has lower risk of producing unsatisfactory outputs in low-entropy scenarios compared to existing unbiased watermarks.
Duwak: Dual Watermarks in Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing watermark techniques are effective in embedding single human-imperceptible and machine-detectable patterns without significantly affecting generated text quality and semantics.
Approach: They propose to embed dual secret patterns in token probability distribution and sampling schemes to enhance the efficiency of watermarking.
Outcome: The proposed method achieves highest watermark quality at the lowest required token count for detection, up to 70% less than existing techniques, especially under post paraphrasing attacks.
PostMark: A Robust Blackbox Watermark for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to detect LLM-generated text require access to the underlying LLM’s logits, which LLM providers are loath to share due to fears of model distillation.
Approach: They develop a post-hoc watermarking procedure that inserts an input-dependent set of words into the text after the decoding process has completed.
Outcome: The proposed method is more robust to paraphrasing attacks than existing methods.
WaterPool: A Language Model Watermark Mitigating Trade-Offs among Imperceptibility, Efficacy and Robustness (2025.naacl-long)

Copied to clipboard

Challenge: Existing methods to trace the usage of large language models often face trade-offs between imperceptibility and robustness.
Approach: They propose a key-centered scheme to unify existing methods by decomposing a watermark into two components: a 'key module' and a "mark module".
Outcome: The proposed method can be integrated with existing methods and achieve near-optimal imperceptibility and detection efficacy.
Topic-Based Watermarks for Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Existing watermarking methods often involve trade-offs between attack robustness, generation quality and additional overhead.
Approach: They propose a topic-guided watermarking scheme that partitions the vocabulary into topic-aligned token subsets.
Outcome: The proposed method achieves text quality comparable to industry-leading systems and improves watermark robustness against paraphrasing and lexical perturbation attacks with minimal performance overhead.
From Trade-off to Synergy: A Versatile Symbiotic Watermarking Framework for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing watermarking methods face limitations that hinder their effectiveness in diverse and adversarial scenarios.
Approach: They propose a symbiotic watermarking framework with three strategies: serial, parallel, and hybrid.
Outcome: The proposed framework outperforms baselines and achieves state-of-the-art (SOTA) performance.
SimMark: A Robust Sentence-Level Similarity-Based Watermarking Algorithm for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Experimental results demonstrate that SimMark surpasses previous sentence-level watermarking techniques in robustness, sampling efficiency, and applicability across diverse domains.
Approach: They propose a sentence-level watermarking algorithm that makes LLM outputs traceable without requiring access to model internals.
Outcome: The proposed algorithm surpasses previous sentence-level watermarking techniques in robustness, sampling efficiency, and applicability across diverse domains while maintaining the text quality and fluency.
Synthetic Text Detection in the Age of Large Language Models: Watermark vs. Automatic Detection (2026.acl-industry)

Copied to clipboard

Challenge: Large Language Models (LLMs) are ubiquitous and capable of generating long coherent texts that look almost indistinguishable from human-written texts.
Approach: They propose to use watermark and automatic detection to detect synthetic texts generated from Large Language Models (LLMs) they evaluate six different models, six different watermark techniques and two different automatic detectors for different levels of syntactic changes.
Outcome: The proposed methods outperform on unperturbed and perturbed datasets on six different sizes of Qwen2.5 models, six watermark techniques and detectors, and two automatic detectors.
WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Recent studies have developed watermarking algorithms which restrict the generation process to leave an invisible trace for watermark detection.
Approach: They propose a benchmarking procedure that compares different methods to ensure consistent watermarking strength and jointly evaluates their generation and detection performance.
Outcome: The proposed benchmark compares 4 open-source watermarks on 2 LLMs under 2 watermarking strengths and observes the common struggles for current methods on maintaining the generation quality.
Watermarking with Low-Entropy POS-Guided Token Partitioning and Z-Score-Driven Dynamic Bias for Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing watermarking methods reduce the fidelity of semantics in LLMs .
Approach: They propose a low-entropy token partitioning mechanism and z-score-driven dynamic bias mechanism to enhance semantics.
Outcome: The proposed framework improves semantic fidelity and robustness against bias sparsity attacks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations