LLM watermarking improves detection and speeds up inference serving
Adaptive Co-Serving LLM Watermarking on Modern Inference Engines
Cryptography and Security
Summary
Watermarking helps show ownership of text generated by large language models (LLMs), but existing methods often slow down these models and need extra tools. The authors created SWIFT, a new system that builds watermarking directly into the model's serving process, making it faster and using less memory. Their approach keeps the output accurate and meaningful while making the watermark easier to detect, even under attacks. Experiments show SWIFT works better and faster than previous methods on many tasks.
What this means in practice
- •For llm service providers: Integrate watermarking seamlessly into LLM serving systems to verify generated content ownership without significant speed or memory costs.
- •For cloud infrastructure teams: Use SWIFT's co-designed watermarking and inference optimizations to reduce resource usage and latency in deploying LLM-powered applications.
Authors
Kieu Dang, Phung Lai, Ching-Yun Ko, Pin-Yu Chen
Abstract
Large language model (LLM) watermarking is important for ownership verification and intellectual property protection. However, existing approaches focus on algorithmic design while treating LLM inference engines as separate components. This separation often introduces auxiliary models or external tools, increasing latency and memory overhead while limiting the use of modern inference optimizations. As a result, a deployment gap remains: practical watermarking must preserve utility, detectability, and robustness while minimizing serving overhead. To bridge this gap, we propose SWIFT, a framework that co-designs LLM watermarking with modern inference infrastructure. SWIFT (i) integrates text generation and watermark construction within a shared LLM backend to reduce re-computation, improve cache reuse, and simplify system complexity; (ii) uses instruction-guided candidate generation with semantic protection to preserve factual consistency and meaning; (iii) executes watermarking concurrently with generation through asynchronous co-serving and adaptive scheduling to reduce latency and improve resource utilization; and (iv) leverages vLLM optimizations to enhance serving efficiency. Extensive experiments across domains and tasks show that SWIFT achieves strong utility, detectability, robustness, and downstream performance while substantially improving serving efficiency. Specifically, it achieves the highest utility score (4.87), 99.65% detection accuracy compared with 76.65% for the low-latency baseline SynthID, and up to 97.7% detection under watermark removal attacks, with 5.9x lower latency than the highest-utility baseline, SafeSeal. These results demonstrate the benefits of co-designing watermarking with inference infrastructure for practical LLM serving. Code and artifacts are available at: https://anonymous.4open.science/r/SWIFT-0597.