Papers for

ai model security teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Latent frequency masking weakens invisible watermarks in ai images

Exploring Weaknesses of Generative Image Watermarks against Latent Frequency Masking

Abstract: Invisible watermarking has become a central tool for tracing AI-generated images, but its robustness against adaptive removal attacks remains an open security question. We introduce Latent Frequency Masking, an attack that erases watermark evidence by replacing selected Fourier coefficients in the latent representation of a watermarked image. The replacement can be sampled from Gaussian noise for efficiency or derived from diffusion regeneration for improved image preservation. We provide a theoretical distortion bound relating the change between the reconstructed adversarial image and the masked latent-frequency perturbation. We evaluate the proposed attack against six diffusion watermarking methods on images generated from DiffusionDB and MS-COCO prompts. Latent Frequency Masking removes or substantially weakens several watermarks while preserving perceptual quality and achieving favorable runtime compared with existing attacks. These results identify latent-frequency manipulation as a practical attack surface and highlight the need to include such attacks in robustness evaluations of generative image watermarking.

Thu 1 OctComputer Vision and Pattern RecognitionArtificial IntelligenceMultimedia
The gist
Invisible watermarks help track AI-generated images but can sometimes be removed by clever attacks. The authors found a new way to erase these watermarks by changing specific frequency parts inside the hidden data of an image. Their method can either use random noise or a more advanced technique to keep the image looking good while removing the watermark. They tested this attack on different watermark systems and showed it can often hide or remove the watermark without hurting the image's quality. This shows that image watermarking needs to be tested against this kind of frequency-based attack.
Open → 2610.02010v1