Optimizing watermarks for large language models

arXiv:2312.17295 · cs.CR, cs.AI, cs.CL · Submitted 2023-12-28 · Read on arXiv

cs.CR, cs.AI, cs.CL

Submitted: 2023-12-28

Updated: 2026-09-23

Comments: 19 pages; publication ICML '24

Journal ref: Proceedings of the 41st International Conference on Machine Learning (ICML), PMLR 235:53251-53269, 2024

DOI: 10.5555/3692070.3694252

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Perplexity — 21× in this paper · explained in 3 episodes
• Multi-objective Optimization — 8× in this paper · explained in 4 episodes
• Robustness — 5× in this paper · explained in 5 episodes
• Transformer — 4× in this paper · explained in 2 episodes
• Consistency — 2× in this paper · explained in 3 episodes
• Distribution Shift — 2× in this paper · explained in 9 episodes
• Large Language Models (LLMs) — 2× in this paper · explained in 8 episodes
• Benchmark — 1× in this paper · explained in 2 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Generative Model — 1× in this paper · explained in 2 episodes
• Generative Models — 1× in this paper · explained in 3 episodes
• Provenance — 1× in this paper · explained in 5 episodes
• Quantization — 1× in this paper · explained in 14 episodes
• Redundancy — 1× in this paper · explained in 2 episodes
• Transfer Learning — 1× in this paper · explained in 13 episodes

Sources

• Watermarking Conditional Text Generation for AI Detection: Unveiling Challenges and a Semantic-Aware Watermark Remedy
• Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigations
• On the Learnability of Watermarks for Language Models
• Unbiased Watermark for Large Language Models
• Evading Watermark based Detection of AI-Generated Content
• Downstream Trade-offs of a Family of Text Watermarks
• A Watermark for Large Language Models
• On the Reliability of Watermarks for Large Language Models
• Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense
• Undetectable Watermarks for Language Models
• Robust Distortion-free Watermarks for Language Models
• Who Wrote this Code? Watermarking for Code Generation
• Watermarking LLMs with Weight Quantization
• Improving the Generation Quality of Watermarked Large Language Models via Word Importance Scoring
• Can AI-Generated Text be Reliably Detected?
• An Unforgeable Publicly Verifiable Watermark for Large Language Models
• Red Teaming Language Model Detectors with Language Models
• A Semantic Invariant Robust Watermark for Large Language Models
• Baselines for Identifying Watermarked Large Language Models
• WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models

Related papers

• SoK: AI-Augmented Binary Reversing
• Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
• Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
• Estimating the Social Cost of Corporate Data Breaches
• Efficient Fuzzy PSI under One-Sided Assumptions
• Sealing the Audit-Runtime Gap for LLM Skills