Papers for

digital content platforms

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Codec guided watermarking improves traceability of diffusion images

CLaW: Codec-Guided Adaptive Latent Watermarking for Traceable Diffusion Image Generation

Abstract: With the rapid advancement of text-to-image diffusion models, increasingly realistic AI-generated content has raised serious concerns about misuse and copyright infringement. Digital watermarking offers a promising solution by enabling user-level traceability, yet existing methods remain difficult to deploy at scale, hindered by costly model retraining or detection, poor effectiveness-fidelity trade-offs, and limited robustness to image transformations. To address these challenges, we propose CLaW (Codec-guided Latent Watermarking), a robust and efficient watermarking framework for traceable diffusion image generation with frozen diffusion backbones and inversion-free detection. Specifically, CLaW first uses a pretrained watermark codec to map each watermark message to a latent residual, enabling low-cost sampling-time injection. Then, the residual is injected within a late denoising window, where image semantics are better preserved and the watermark signal is less perturbed by subsequent denoising updates, yielding a better balance between watermark effectiveness and image fidelity. Furthermore, we introduce a decoder-guided adaptive injection mechanism that uses decoding confidence as feedback to dynamically calibrate watermark strength, reinforcing weak watermark signals and improving robustness under image transformations. Extensive experiments show that CLaW preserves high visual fidelity and achieves state-of-the-art robustness under image transformations, enabling reliable user-level traceability.

Thu 29 OctComputer Vision and Pattern RecognitionCryptography and Security
The gist
AI can now create very realistic images from text, but this makes it hard to tell which images were made by which user, causing issues like misuse and copyright problems. The authors present CLaW, a method that hides special codes inside generated images without changing how they look much. These codes can be detected later without needing to change the AI model, even after the image is edited. This helps track who created the image while keeping pictures clear and resistant to distortions.
Open → 2610.39160v1

Discrete tokens match continuous visuals in multimodal AI understanding

Can Discrete Tokens Serve as Semantically Lossless Representations of Visual Signals?

Abstract: Discrete visual tokens represent vision in a discrete form analogous to language, offering a native interface for multimodal modeling under a shared next-token prediction objective. However, quantization error is widely assumed to cause unavoidable semantic loss, fundamentally limiting the semantic fidelity of discrete visual tokens and positioning continuous visual representations as an intrinsic upper bound. Using multimodal understanding as a proxy for semantic fidelity, we revisit this assumption and find quantization error unreliable, as discrete representations with substantially larger errors can achieve better understanding. Instead, the effective bit budget of discrete indices emerges as a key determinant of downstream performance. However, existing quantizers eventually saturate as additional codebooks contribute progressively less semantic information. As one approach to alleviating this saturation, we introduce Factorized Vector Quantization, which quantizes complementary, fixed-dimensional views of the visual feature with symmetric parallel codebooks. It continues to improve at larger bit budgets, ultimately matching continuous visual representations in multimodal understanding. Trained on industrial-scale multimodal data, our model achieves state-of-the-art performance among discrete-representation models, outperforming UniAR and Emu3-Chat by 22.8% and 59.2%, respectively, on a nine-metric average. To our knowledge, it is also the first discrete-representation model competitive with strong continuous-representation models such as Qwen3-VL, including on fine-grained OCR tasks. We further identify the key principles and a practical recipe enabling this competitiveness. These results and insights support the potential of discrete visual representations to underpin large-scale native multimodal foundation models. Code and models are available at https://github.com/hustvl/FVQ

Tue 27 OctComputer Vision and Pattern Recognition
The gist
Visual information can be turned into pieces called discrete tokens, like words in a sentence, to help computers understand images together with text. It's usually thought that these tokens lose important meaning compared to continuous image data. The authors found that more bits used to represent these tokens improve understanding and introduced a new way to split and encode image features that beats old methods. Their approach performs as well as continuous representations on complex tasks, including reading fine text in images, making discrete tokens a good option for future AI that combines images and language.
Open → 2610.37662v1

Semantic complexity of text measured using transformer attention

Quantifying Meaning with SCAPE-T: Semantic Complexity from Encoder-Only Transformer Attention

Abstract: Automated semantic complexity estimation remains underexplored in NLP, despite important applications in linguistics and interpretability. This paper defines semantic complexity as the code length required to uniquely specify a text's semantic meaning, and operationalises it via SCAPE-T, an attention-derived metric based on encoder-only transformers. Existing measures either model reader effort (readability, lexical difficulty), which correlates with surface features (word length, syntax), or quantify surface features directly (type-token ratio, word frequency). SCAPE-T targets semantic integration directly by combining three submetrics: (i) inverse-weighted self-focus (token-to-self), (ii) CLS focus (token-to-CLS), and (iii) inter-head redundancy (cosine similarity across heads), using layer-weighted aggregation; data-driven learning is confined to hyperparameter tuning for calibration. Development uses philosophical prose vs. MCTest stories; evaluation is on children's stories vs. technical Wikipedia articles, with pairwise accuracy on contrasts as the primary criterion. Baselines include readability, syntactic/lexical, and LLM-derived measures. SCAPE-T substantially outperforms all tested baselines under word-length control, with a pairwise accuracy of 78.5% (95% bootstrap CI: 76.1-80.4, N=10k pairwise comparisons; +12.7 percentage points over the strongest baseline); without that control, readability heuristics overtake, consistent with their reliance on surface features. On a short-terms abstractness dataset, SCAPE-T also leads. Ablations show each submetric contributes materially. Overall, the results show SCAPE-T isolates conceptual structure from lexical/syntactic confounds better than existing methods, and generalises across two held-out domains.

Sat 24 OctComputation and LanguageArtificial Intelligence
The gist
Measuring how complex a text's meaning is can be tricky. The paper defines semantic complexity as how much information is needed to uniquely describe the meaning of a text. The authors introduce SCAPE-T, a new way to measure this complexity by looking inside attention patterns of transformer models, a type of AI used for language. Their method works better than existing ones that rely on word or sentence features, and it can tell apart texts by how conceptually complex they are.
Open → 2610.33441v1

Concise captions and re-ranking improve image retrieval accuracy

Less is More: Concise Retrieval and Critic-based Re-ranking for Composed Image Retrieval

Abstract: Zero-shot composed image retrieval (ZS-CIR) aims to retrieve a target image based on a reference image and modification text. Recent approaches commonly rely on large vision-language models to generate target image captions for retrieval. However, these captions may include redundant semantic details, introducing noise when retrieving the target image and leading to suboptimal retrieval results. To address this issue, we propose Less-is-More CIR, a two-stage training-free framework that combines Concise Retrieval and Critic Re-ranking. In the first stage, concise target-oriented captions are generated that preserve only the most discriminative modification semantics, thereby reducing semantic noise in the retrieval. In the second stage, a critic re-rank module further evaluates the retrieved candidates from the perspectives of modification consistency and reference preservation. Extensive experiments demonstrate the effectiveness and robustness of the proposed framework for the ZS-CIR. Our code is available at: https://github.com/dxlabskku/LM-CIR.

Tue 20 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Finding pictures that match changes described by text can be tricky when the descriptions include too much extra detail. The authors created a method that first makes short, focused descriptions emphasizing only the important changes. Then, they check the top pictures again to make sure they really fit the description and the original image. This two-step approach helps computers find the right pictures more accurately without needing new training.
Open → 2610.27538v1

Proactive image protection shows changing robustness under repeated edits

PREEMPT: Proactive Robustness Evaluation under Editing for Media Protection Techniques

Abstract: Proactive image protection methods aim to defend visual content against unauthorized manipulation and generative misuse by embedding protective signals into images before release. Evaluating whether these protections remain effective under image editing is therefore critical. However, existing evaluations remain largely limited to one-shot edits, providing only a static view of robustness while overlooking its evolution under realistic multi-step editing workflows. To systematically characterize robustness dynamics under sequential editing across various protection paradigms, we introduce PREEMPT, a holistic evaluation framework. It evaluates protection robustness under both one-shot and sequential editing scenarios, covering image transformations, semantic edits, homogeneous and heterogeneous edit compositions. To enable consistent analysis across protection paradigms with different underlying objectives, PREEMPT normalizes task-specific effectiveness into protection survival trajectories and summarizes long-horizon robustness through trajectory-based diagnostics. Using this framework, we reveal that degradation behaviors remain hidden under conventional one-shot evaluation. Furthermore, perturbation- and watermark-based protection methods exhibit different failure modes, and the first semantic edit largely determines subsequent degradation trajectories. PREEMPT provides a standardized protocol for studying long-horizon robustness and offers new insights into the degradation dynamics of proactive image protection.

Fri 16 OctComputer Vision and Pattern Recognition
The gist
Images can be protected by embedding signals that stop unauthorized changes or misuse. The paper introduces PREEMPT, a way to test how well these protections hold up when images are edited multiple times, not just once. The authors found that protections can fail in different ways depending on the method used and that the first edit influences future changes a lot. Their method helps understand how image protections degrade over time with realistic editing.
Open → 2610.24205v1

Tailor composes watermarks for robust and clear image protection

Made to Measure: Designing Image Watermarks to Specification

Abstract: Image watermarking supports provenance and attribution by embedding verifiable identity information into images. Practical deployments, however, must jointly satisfy requirements for attack resistance, false-positive rate (FPR), image quality, and latency. Existing watermarking methods are robust to different classes of transformations, so combining complementary methods can provide broader protection than any single watermark. Such composition is challenging, as additional fragments increase distortion and decoding cost and must share the same FPR budget. Therefore, we propose **TAILOR**, a request-conditioned watermark composition framework with three stages: (1) *offline characterization* measures fragment recovery, distortion, and runtime as response curves over embedding strength; (2) *joint configuration selection* encodes the request as an SMT model over these curves and solves for the lowest-distortion composition of fragments, strengths, order, and geometric recovery; and (3) *live calibration* validates the selected configuration on the user's images and refines predictions that fail to transfer. Experimental results across 7,321 distinct requests spanning five scenarios and 20 attack settings show that **TAILOR** achieves **96.21%** scenario-averaged request satisfaction with a mean PSNR of **41.02 dB**, outperforming existing methods in robustness while achieving consistently better image quality. Code is available at [https://github.com/aaFrostnova/Tailor](https://github.com/aaFrostnova/Tailor).

Wed 30 SeptCryptography and Security
The gist
Images often carry hidden watermarks to prove who owns them or where they come from. The authors present Tailor, a system that smartly combines different watermarking methods to protect images while keeping them looking good and making sure the watermarks are easy to decode. Tailor figures out the best way to add these marks based on the user's needs and then fine-tunes the process on the actual images. Their tests show Tailor is better at protecting images and keeping their quality high than other approaches.
Open → 2610.00780v1

Information limits of watermarking images from pretrained AI generators

On the Information-Theoretic Limits of Latent-Space Watermarking Through Pretrained Generators

Abstract: We study latent-space watermarking through a pretrained generator using a prescribed latent-to-output stochastic mapping, called the renderer. A watermark encoder selects the latent input using a message and secret key. For every message and semantic context, the released output must have exactly the desired conditional output distribution. For finite alphabets, we derive rate--key inner and outer bounds and characterize the coding and coordination requirements for realizing watermark communication through the prescribed latent interface. When the target output distribution of the generator uniquely determines the corresponding latent input distribution through the renderer, a strengthened converse yields the capacity region; the same region governs explicit preservation of the pretrained latent distribution. We extend the analysis to general jointly Gaussian models and identify a sufficient statistic of the latent that captures both the watermark-bearing information available at the generated output and the latent coordination required to preserve its target distribution. For the vector Gaussian model, we further characterize the optimal allocation of the secret-key resource across the resulting modes. Finally, we turn to an emerging robustness threat that is particularly natural in generative watermarking: an adversary can regenerate the released sample to obtain a fresh realization of the same underlying content while attenuating or destroying the embedded watermark. We incorporate this robustness axis into our framework and characterize the one-pass compound capacity of the scalar Gaussian model when the semantic context is known to the encoder but hidden from the detector, while the regeneration attack may depend on that context. Extending the analysis to multiple rounds of repeated canonical regeneration, we characterize the resulting watermark-capacity decay.

Mon 21 SeptInformation TheoryMachine Learning
The gist
This paper studies how much secret information, or watermarks, can be hidden in images created by AI generators when using a secret key and a message. The authors look at the limits on reliably hiding watermarks while keeping the images realistic and unchanged in style. They find mathematical bounds for how much information can be encoded and how this changes when an attacker tries to remove the watermark by regenerating the image. Their work helps understand how watermarks can be hidden in AI-created images and how robust these marks are to attacks.
Open → 2609.24377v1

Efficient unified model improves image tagging detection and captioning

Efficient Unified Multimodal Understanding (EUMU): Winning Solution for the MUMU Track at the 8th LSVOS Challenge

Abstract: The Mobile Unified Multimodal Understanding (MUMU) Challenge requires a single efficient model to jointly perform multi-concept image tagging, open-vocabulary object detection, and image captioning. We present Efficient Unified Multimodal Understanding (EUMU), the winning solution for the MUMU Track of the 8th LSVOS Challenge. EUMU builds on a shared pretrained multimodal model, using its prompt-based capabilities for detection and captioning and training lightweight heads on shared visual features to predict quality, scene, and event tags. Rather than treating the three tasks independently, EUMU applies task-aware inference refinement by reusing task outputs as cross-task cues. For detection, caption cues help recover objects missed by the initial detection. For captioning, detection cues help refine the caption to better reflect the detected objects. For tagging, image statistics refine quality predictions, while caption and detection cues refine scene and event predictions. This design unifies all three tasks within a single model while satisfying the challenge's resource constraints. EUMU contains 239.169M parameters, requires 23.947 GFLOPs, uses 4.5 GB of peak inference memory, and achieves a final challenge score of 17.3409. Code and models are available at https://github.com/Dayoung-Kil/EUMU.

Wed 16 SeptComputer Vision and Pattern Recognition
The gist
The problem is how to build one smart and fast model that can look at pictures and do three things: tag what’s in them, find specific objects, and write captions about them. The authors created a method called EUMU that uses one shared model to do all three tasks together more efficiently. They also made the tasks help each other by sharing information, making the results better. This approach won a challenge by using resources carefully and working well on all tasks.
Open → 2609.19451v1

Region aware method speeds semantic watermark extraction from diffusion images

RAIN: Region-Aware Inversion Network for Semantic Watermark Extraction

Abstract: Semantic watermarks for diffusion models embed ownership information into the generative process while preserving perceptual quality, but Gaussian-Shading extraction conventionally requires multi-step diffusion inversion to recover the initial noise. Recent one-step methods show that this cost can be reduced substantially. We study this problem through extended flow matching and conditional regression. The key observation is that, near the high-SNR image endpoint, recovering a useful noise statistic given by the first-step output of the extended flow matching in the high-SNR regime is much simpler than reconstructing the full inverse trajectory, and Gaussian Shading only requires the recovered latent to remain in the correct watermark decision region. Based on this observation, we propose a lightweight, prompt-free extractor that decomposes endpoint recovery into an image-like anchor and a noise-oriented residual, which increases the capability of the model to utilize GPU parallel computation. The resulting method avoids iterative inversion and repeated evaluation of a diffusion-scale U-Net, providing an efficient one-step extraction pipeline with a concise theoretical interpretation. The computational cost of extracting noise is lower than that of both OSI and FARI. The github repo is there: https://github.com/TheLovesOfLadyPurple/RAIN-lightweight-NN-for-one-step-semantic-watermark-extraction

Mon 14 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Extracting hidden ownership marks in AI-generated images usually takes several slow steps. The authors show it’s simpler to focus on just the important parts near the final picture, making the process faster and less complex. They build a new tool that breaks down the recovery into easier pieces, so it runs quickly on modern GPUs without extra prompts. This method avoids repeated, costly computation, making watermark reading more efficient.
Open → 2609.14856v1