Papers for

advertising agencies

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Model generates images and layouts together for better design templates

Learning Interaction between Image and Layout Priors for Joint Image-Layout Generation in Design Templates

Abstract: In this paper, we address the problem of graphic design template creation, which generates a background image and a layout of foreground elements over the background to form a harmonious composition from an input text. Prior work on graphic design generation mostly adopts a sequential paradigm, where design elements are generated sequentially. We argue that such a sequential scheme falls short of faithfully capturing the dependency between the background and layout (and thus the joint image-layout distribution), which limits the quality of generated design templates. To overcome this limitation, we propose a model, InterIL, which jointly generates the two modalities, background image and layout, in a single generative process. The novel design of our joint model connects the backbones of pretrained image and layout diffusion models with a learnable communication module to explicitly model bidirectional image-layout interaction. During training, the image and layout backbones are frozen to maintain and leverage the vast pretrained single-modality prior knowledge, while only the communication module is updated, so that the model can focus on learning image-layout interaction and thereby better capture the joint image-layout distribution for improved composition harmony. Our model has no design-specific inductive bias, which allows it to better preserve the original characteristics of realistic designs. We further introduce a test-time guidance strategy to enable users to impose their specific preferences on generated results. Our experiments show that, compared with prior approaches, our model can generate significantly better results in terms of image, layout and image-layout harmonization, producing outputs closer to real samples. We also demonstrate the flexibility of our model in enforcing user preferences at inference without retraining.

Thu 10 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceGraphics
The gist
Creating graphic design templates usually means making a background image and placing items on top one after another. The authors found this sequential method misses how backgrounds and layouts affect each other. They built a new model that creates the background and layout at the same time, letting them interact during the process. This approach keeps the realistic look of designs and lets users guide the results without retraining the model.
Open 2609.11519v1

Multi subject video generation gains precise control and better identity consistency

Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generation

Abstract: Multi-subject video generation faces two key challenges: uncontrollable fidelity strength and potential semantic drift. We address these by analyzing the internal mechanisms of Diffusion Transformers (DiTs). We found that certain attention blocks naturally form an Intrinsic Spatial Grounding Map (ISGM) that precisely locates reference subjects. Building on this insight, we propose Dual-phase Intrinsic Attention Leveraging (DIAL), a framework that uses these internal signals for both training and inference. In low-noise stages, we use ISGM to guide the attention mechanism, allowing precise control over fidelity strength during inference without retraining. In high-noise stages, we use these same maps to automatically build preference pairs at no additional cost for Reinforcement Learning (RL). This RL procedure effectively anchors the model's attention to reference subjects and mitigates semantic drift. Extensive experiments show that DIAL significantly outperforms baseline models on the OpenS2V-Eval benchmark, consistently improving identity consistency and enabling controllable fidelity strength.

Thu 10 SeptComputer Vision and Pattern Recognition
The gist
Generating videos with multiple people or subjects is hard because it’s difficult to control how closely the video matches the input references and to avoid mixing up who is who. The authors studied how a type of AI model focuses on different parts of the video and found it naturally highlights each subject’s location. Using this, they created a method that guides the model during generation to keep subjects clear and consistent. Their method also uses rewards during training to prevent the model from drifting away from the subjects. This leads to videos that better maintain each subject’s identity and allow users to control the quality without needing to retrain the model.
Open 2609.11507v1

CamPilot improves text to movie creation with cinematic camera control

CamPilot: A Multi-Agent Cinematic Assistant for Camera-Controlled Movie Generation

Abstract: The integration of large language models (LLMs) into video generation has enabled rapid text-to-video creation and improved visual quality. However, it still falls short of professional filmmaking, where cinematographic language is less refined than human-crafted camera work and multi-shot continuity remains challenging. To address these limitations, we introduce CamPilot, a multi-agent framework that integrates cinematographic planning and camera-work control to produce more coherent, logically structured, and human-aesthetic movies. CamPilot adopts a GRPO-based learning paradigm to learn camera work planning from 14K real-world professional movies, internalizing motion patterns and composition principles that support reasoning over shooting techniques (e.g., camera angle, motion, and focal behavior) and cross-shot relationships for controllable camera-viewpoint generation. Multiple agents further collaborate and evolve to improve overall output quality. To support this work and further studies in this domain, we establish CamEval, a benchmark for evaluating camera work quality and cinematic engagement. Empirical results show that CamPilot outperforms state-of-the-art text-to-movie generation methods on cinematographic control and quality, highlighting the impact of professional camera design on movie generation.

Thu 10 SeptComputer Vision and Pattern Recognition
The gist
Making movies with computers is still hard because camera movements and shots often look less natural than those made by human filmmakers. The authors created CamPilot, a system that learns from thousands of professional movies how to plan camera angles and motions in ways that look artistic and natural. It uses multiple AI agents working together to control the cameras and keep scenes connected smoothly. Their method results in videos that look more like real movies than previous automatic systems.
Open 2609.10943v1