Challenge: Existing methods to watermark low-entropy content are expensive and risky . IE reduces parameter size by 99% while achieving performance on par with state-of-the-art methods .
Approach: They propose a logit-based watermarking paradigm that uses entropy-based features to predict whether the next token is high or low.
Outcome: The proposed method reduces parameter size by 99% while achieving performance on par with state-of-the-art methods.

Similar Papers

An Entropy-based Text Watermarking Detection Method (2024.acl-long)

Copied to clipboard

Challenge: Existing text watermarking algorithms for large language models (LLMs) are effective in identifying machine-generated texts, but they are not effective in low-entropy scenarios.
Approach: They propose an Entropy-based text watermarking detection method that takes into account the influence of token entropy to better reflect the degree of watermark detection.
Outcome: The proposed method is training-free and fully automated.
Low-Entropy Watermark Detection via Bayes’ Rule Derived Detector (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods for text watermarking ignore strong evidences embedded in low-entropy tokens, causing statistical measures to falsely indicate the absence of a watermark.
Approach: They propose a Bayes' Rule derived watermark Detector which exploits watermark information from every token by leveraging the posterior probability of watermark’s presence.
Outcome: The proposed method achieves 50% and 70% relative improvements over baselines in code generation and math problem-solving tasks.
Bypassing LLM Watermarks with Color-Aware Substitutions (2024.acl-long)

Copied to clipboard

Challenge: Existing methods to detect large language models (LLMs) generated text are susceptible to a large number of false positives.
Approach: They propose a watermarking approach that uses color information to determine token colors and substitute green tokens with non-green ones.
Outcome: The proposed method evades detection with fewer edits and removes the watermark for arbitrarily long watermarked text.
EntroBench: Evaluating LLM Watermarking Under Multi-Entropy Scenarios and Practical User Operations (2026.findings-acl)

Copied to clipboard

Challenge: Existing evaluations of large language models (LLMs) watermarking are limited to fixed entropy settings.
Approach: They propose a benchmark for LLM watermarking that systematically covers three entropy levels and seven representative tasks.
Outcome: The proposed framework covers three entropy levels and seven representative tasks.
Marking Code Without Breaking It: Code Watermarking for Detecting LLM-Generated Code (2026.findings-eacl)

Copied to clipboard

Challenge: Existing methods for identifying LLM-generated code are limited by syntax-critical tokens, which can introduce syntax errors.
Approach: They propose a syntax-aware watermarking method that embeds watermarks only in non-syntactic tokens and preserves code integrity.
Outcome: The proposed method outperforms baseline methods on Python, C++, and Java.
A Reinforcement Learning Framework for Robust and Secure LLM Watermarking (2026.eacl-long)

Copied to clipboard

Challenge: Existing watermarking algorithms rely on heuristic green/red token lists . however, these lists are inconsistent and can be compromised .
Approach: They propose a framework for robust and secure LLM watermarking using reinforcement learning.
Outcome: The proposed method achieves state-of-the-art trade-off across all criteria with notable improvements in resistance to spoofing attacks without degrading other criteria.
PostMark: A Robust Blackbox Watermark for Large Language Models (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods to detect LLM-generated text require access to the underlying LLM’s logits, which LLM providers are loath to share due to fears of model distillation.
Approach: They develop a post-hoc watermarking procedure that inserts an input-dependent set of words into the text after the decoding process has completed.
Outcome: The proposed method is more robust to paraphrasing attacks than existing methods.
Watermarking Large Language Models: An Unbiased and Low-risk Method (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have highlighted the risk of misusing them, raising the need for accurate detection of LLM-generated content.
Approach: They propose a method to inject imperceptible identifiers into large language models (LLMs) this method is unbiased and preserves the original token distribution in expectation .
Outcome: The proposed method preserves the original token distribution in expectation and has lower risk of producing unsatisfactory outputs in low-entropy scenarios compared to existing unbiased watermarks.
Watermarking with Low-Entropy POS-Guided Token Partitioning and Z-Score-Driven Dynamic Bias for Large Language Models (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing watermarking methods reduce the fidelity of semantics in LLMs .
Approach: They propose a low-entropy token partitioning mechanism and z-score-driven dynamic bias mechanism to enhance semantics.
Outcome: The proposed framework improves semantic fidelity and robustness against bias sparsity attacks.
From Trade-off to Synergy: A Versatile Symbiotic Watermarking Framework for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing watermarking methods face limitations that hinder their effectiveness in diverse and adversarial scenarios.
Approach: They propose a symbiotic watermarking framework with three strategies: serial, parallel, and hybrid.
Outcome: The proposed framework outperforms baselines and achieves state-of-the-art (SOTA) performance.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations