Papers for

graphic designers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Diffusion model method improves story image sequences with adaptive scenes

Not Just a Subject: Capturing Adaptive Scene-Specific Variance for Visual Storytelling

Abstract: Recent advancements in diffusion models have significantly improved text-to-image generation, enabling their application to visual storytelling, where coherent image sequences are generated from narrative prompts. However, existing methods primarily focus on identity preservation and often fail to adapt to diverse scene variations, resulting in semantic misalignment and structural inflexibility. We propose EOS-Story, a training-free framework that harmonizes identity consistency with scene-specific adaptation across text and vision spaces. In the text space, we decouple the narrative into identity and scene sub-prompts to prevent information dilution, but this leaves the scene without access to appearance cues. To bridge this gap, we introduce Cross-Contextual Bridging, which softly injects a phrase-level appearance residual into the scene's <EOS> embedding. In the vision space, we find that scale mismatch between identity and scene subjects causes a few identity tokens to be repeatedly transferred, producing structural artifacts. We address this with Adaptive Identity Preservation, which anchors identity features at the scene-specific scale (Identity Anchoring) and integrates them via Identity-Aware Self-Attention. To evaluate performance under varied spatial compositions, we extend the Consistory+ benchmark with diverse framing scenarios (Consistory+_+). Extensive experiments show that EOS-Story achieves competitive or superior performance on both benchmarks.

Thu 15 OctComputer Vision and Pattern Recognition
The gist
Generating a series of pictures from a story is tricky because the images need to keep characters looking the same while changing their surroundings naturally. The authors propose EOS-Story, a way to keep both the character’s identity and the changing scene details balanced without extra training. They split the story into parts about who is in the image and where they are, then carefully mix appearance details so scenes fit better. Their approach also fixes scale problems in images that caused weird shapes before. Tests show their method helps make more coherent and flexible visual stories.
Open → 2610.22320v1

CoDeFont improves one-shot font style transfer across diverse scripts

CoDeFont: One-Shot Font Generation via Multi-Scale Factor-Specific Representation Learning

Abstract: One-shot Font Generation (OFG) aims to synthesize a target glyph by transferring the stylistic characteristics of a single reference glyph while preserving the structure of the target character. However, accurately capturing font style from a single reference image remains challenging due to the limited stylistic information available in a single glyph, and this challenge is further amplified for complex scripts. We propose CoDeFont, a script-agnostic OFG framework that addresses this challenge through multi-level style-content factorization and progressive style-content reconciliation. CoDeFont independently aggregates complementary style and structural information across multiple spatial levels to obtain factor-specific representations, while a contrastive objective explicitly encourages separation between style and content embeddings. During reconstruction, the disentangled representations are progressively injected through multi-level style conditioning, enabling stylistic information to be incorporated at different decoding resolutions while preserving the underlying glyph structure. We evaluate CoDeFont on structurally distinct Bengali and Latin scripts across seen and unseen font styles. Extensive quantitative and qualitative analyses demonstrate consistent improvements over existing state-of-the-art methods, highlighting the effectiveness of the proposed framework for OFG across diverse writing systems.

Thu 15 OctComputer Vision and Pattern Recognition
The gist
Creating a new font style from just one example letter is very hard, especially for complex alphabets. The authors propose CoDeFont, which breaks down style and shape features from different spatial levels in the example to better understand the font’s look. This lets the system recreate different letters in the same style more accurately, even for complicated scripts like Bengali. Their tests show CoDeFont works better than previous methods for generating fonts from a single example.
Open → 2610.21364v1

Atelier adds user controls for smarter AI image editing

From Semantic Editing Intentions to Persistent Parametric Controls for AI-Assisted Image Editing

Abstract: AI-powered image editing increasingly allows users to express high-level editing intentions, yet how these intentions are translated into concrete editing actions often remains difficult to understand. We present Atelier, a semantic image editing tool that uses image semantics and user intent to determine which editing controls to surface and how to initialize them. Guided by a formative study with eight image-editing practitioners, Atelier composes context-specific, directly manipulable controls that users can refine rather than committing AI interpretations directly to finished edits. In a within-subjects study with 12 practitioners, participants preferred AI-composed controls, described them as supporting creative exploration, and actively refined AI proposals. However, experiences of control were mixed, and interviews highlighted limited insight into why particular controls and values were proposed. Our findings suggest that making AI interpretations actionable through manipulable controls can support exploration and refinement, but actionability alone does not make those interpretations transparent to all users.

Wed 14 OctHuman-Computer Interaction
The gist
Editing images with AI can be confusing because it’s hard to see how the AI changes match what you want. The authors created a tool called Atelier that shows users simple controls based on what the AI thinks you want to do, so you can adjust these controls yourself instead of accepting the AI’s edits right away. People who tested Atelier liked having these controls because it helped them explore creative ideas. However, some found it unclear why certain controls were offered, showing that control alone doesn’t explain AI behavior.
Open → 2610.20283v1

Coding agents construct images with precise structure and internal scene understanding

How Far Can Coding Agents Go in Visual Generation?

Abstract: Modern image generation largely relies on specialized generative models that leave the process of image construction implicit in learned parameters. We explore an alternative: general-purpose coding agents that construct images through executable programs. Our study of zero-shot drawing on AgentDrawBench, a 200-prompt benchmark, reveals a distinctive capability profile. Agents excel at preserving structure and satisfying precise visual constraints, achieving competitive results in domains where compositional accuracy matters more than photorealistic appearance, while remaining limited in perceptual richness. Their visual expressiveness varies with the drawing interface, and a qualitative study on reconstruction shows how procedural skills extracted from human demonstrations support different artistic media. We then examine code as an external visual language of thought: a structured, executable representation that agents can construct and inspect. We test it in visual question answering task and find reconstructed visual code retains substantial information for question answering and, in some domains, supports higher accuracy than the original image. These abilities raise a further question: do agents draw on a shared internal representation of scene content beyond a particular drawing program? We explore an internal visual language-of-thought hypothesis, in which a shared, compositionally structured representation supports visual operations across drawing languages. Cross-harness drawings and images assembled from independent single-pixel queries exhibit related layouts and tones. Agents also maintain self-generated room arrangements across viewpoints after visible drawings are removed. These results demonstrate that the coding agent would maintain a consistent and coherent world inside its imagine even before the harness gets involved and the generation starts.

Tue 13 OctComputer Vision and Pattern RecognitionMachine Learning
The gist
Modern image generators usually create pictures by tweaking model parameters invisibly, but this paper looks at coding agents that build pictures by writing programs you can run. The authors find these agents are very good at drawing images with accurate shapes and clear layouts, even if the pictures aren't very realistic. They also show that these coding programs keep enough visual information to answer questions about the image better than looking at the pictures directly. Finally, the agents seem to have an internal way of imagining scenes that stays consistent even without showing images yet.
Open → 2610.19025v1

AesCode improves visual code generation using image-based feedback

AesCode: Aesthetic Code Generation with Decoupled Cross-Modal Rewards

Abstract: Generating information-rich visual artifacts such as slides, posters, and dashboards as code is appealing because the outputs are structured, editable, and verifiable. Yet code models cannot see how their choices of layout and color come together on the canvas, often limiting spatial planning and aesthetic quality. Image generators excel at visual design but can misrender requested content, making their outputs unreliable targets for direct reproduction. We therefore introduce AesCode, which generates code grounded in the content prompt while using an image generated from the same prompt as an aesthetic guidance. To do so, AesCode represents the target as a design graph that describes the whole canvas and makes each property attributable. From this graph, we derive complementary cross-modal rewards: deterministic verifiers score properties parsable from code and rendering, while a VLM judge assesses the non-parsable ones with a sample-specific Visual Graph Rubric (VGR) tied to graph elements and relations. We optimize these decoupled rewards through reinforcement learning with per-channel normalization to jointly improve spatial planning, aesthetic quality, and verifiable correctness. To evaluate this setting, we build a benchmark that scores verifiable correctness and visual quality separately, with visual scores highly consistent with human judgments. We find that reference images substantially improve the visual quality of code generated by existing models, and ablations show that AesCode benefits from references both as model input and as a source of visual rewards. Relative to same-scale Qwen3-VL baselines given the same references, AesCode-8B and AesCode-32B improve visual quality by 31.1 and 22.4 percentage points, reaching scores comparable to those of closed-source frontier models such as GPT-5.5 and Claude Opus 4.8.

Tue 13 OctArtificial Intelligence
The gist
Creating code that produces visual designs like slides and dashboards is hard because code models can’t see how the design looks, leading to poor layouts. The authors introduce AesCode, which uses images generated from the same instructions as the code to guide the code’s design choices. This method helps the system plan space better, improve aesthetics, and ensure the code matches the content accurately. Their tests show AesCode produces more visually appealing and correct code than previous models.
Open → 2610.18860v1

Appearance aware matching improves texture interpolation quality

Texture Interpolation as Texton Matching

Abstract: Texture interpolation asks what should lie between two textures. Standard methods typically blend pixels or features at corresponding spatial locations, implicitly assuming that co-located elements should be mixed. For unrelated textures, however, this correspondence is arbitrary: a crack at one location has no particular relationship to a fiber at the same location in another image. We study whether this hidden pairing choice is itself a major determinant of interpolation quality. We represent textures as collections of local appearance vectors, or textons, and replace positional pairing with appearance-aware matching while keeping the encoder, representation, and decoder fixed. This isolates the effect of correspondence from changes in model capacity or training. Across texture pairs, appearance-aware matching consistently improves the distributional quality of interpolated midpoints over positional feature blending. Soft matching produces the strongest midpoint statistics, whereas one-to-one assignments yield more balanced transitions and closer agreement with the target endpoint. The same intervention also improves a second pretrained texture interpolator without retraining. These results identify correspondence as a first-class design choice in texture interpolation: meaningful transitions depend not only on how strongly two textures are mixed, but also on which local appearances are mixed with one another.

Tue 13 OctComputer Vision and Pattern RecognitionGraphicsMachine Learning
The gist
When blending two different textures, simply mixing points in the same spots often creates unrealistic results because those spots may represent unrelated features. The authors show that matching parts based on how they look, rather than where they are, makes the transition between textures look more natural. By focusing on matching similar local textures instead of just blending by position, the resulting mix better captures the feel of both textures. This approach works even without changing the texture-processing model, highlighting how important the matching choice is.
Open → 2610.18655v1

Graphic design tool creates layouts by editing image backgrounds

Content-Edited Layout Generation for Graphic Design

Abstract: In this paper, we formulate a novel form of conditional layout generation for graphic design, termed content-edited layout generation(CELG). CELG extends conventional content-aware layout generation (CLG), which generates a foreground layout for a fixed background image. The key distinction is that CELG treats the input image as an editable visual asset and, conditioned on a textual design intention and a foreground requirement that may be empty, produces an adapted background together with its layout. To study this task, we introduce Search-Compare-Edit(SCE), a data construction framework that supplies the paired supervision missing from existing design datasets. Starting from professional design canvases and their layouts, SCE synthesizes plausible pre-edit source images and corresponding editing instructions, yielding InstructEdit, a dataset of aligned source images, target canvases, instructions, and layouts. Based on the generated data, we train a two-flow multimodal flow matching model that couples a pretrained image editor with a layout flow transformer, enabling background editing and layout generation simultaneously within a unified framework that more closely reflects real-world design workflows. Our experiments systematically demonstrate the value of CELG as a distinct task and the performance advantages of the proposed model.

Tue 13 OctGraphics
The gist
Graphic design layouts often combine images and text, but existing tools usually make layouts for fixed background pictures only. The authors introduce a new method called content-edited layout generation (CELG), which can change the background image based on given editing instructions and then create a matching layout on top. To train their system, they built a new dataset by simulating edits on professional designs, pairing before-and-after images with instructions. Their model can edit backgrounds and generate layouts at the same time, better mimicking how real graphic designers work.
Open → 2610.17905v1

Flow models fix local image errors with targeted patch alignment

Diagnose-to-Generate: Eliminating Structural Distortions in Flow Models via Patch-Level Grounded Alignment

Abstract: Flow-based image generators achieve strong semantic synthesis but still produce localized structural distortions, such as malformed hands and limbs. Existing post-training methods typically optimize global scalar rewards, which provide weak spatial credit assignment and may alter well-formed regions while correcting local defects. We present \textit{Diagnose-to-Generate (D2G)}, a grounded alignment framework that separates visual diagnosis from generative optimization. We construct \textbf{Achilles-600K}, a region-annotated dataset for structural anomalies, and train \textbf{ARGUS} through supervised cold-start and Region-Aware Group Relative Policy Optimization to predict anomaly categories and bounding boxes. These diagnoses are converted into confidence-weighted spatial rewards for our \textbf{Patch-level Flow-GRPO}. We further identify that global stochastic exploration can shift semantic regions across group rollouts, making patch-wise relative advantages spatially inconsistent. Our \textbf{Trajectory-Preserving Stochastic Sampling (TPSS)} anchors early denoising with deterministic ODE trajectories and introduces stochasticity only at later steps, thereby limiting intra-group spatial drift while retaining local exploration. Experiments on FLUX.1-dev and SD3.5 show improved structural fidelity with preserved FID and CLIP scores. Consistent gains under HumanRefiner, zero-shot GPT-4.1, and blinded human evaluation further demonstrate that the improvements extend beyond the training reward model.

Tue 13 OctComputer Vision and Pattern Recognition
The gist
Flow-based image generators can make detailed pictures but often mess up small parts, like hands or limbs. The authors made a new way called Diagnose-to-Generate that finds and fixes these errors in specific image areas rather than guessing everywhere. They built a special dataset with labeled problem spots and trained a model to spot these errors, then used that info to carefully fix just the bad parts. This method improves image quality without hurting overall style or meaning, and people checked it using humans and different tests.
Open → 2610.17882v1

QK Edit improves multimodal transformers for image and video editing

QK-Edit: Revisiting Attention-based Injection in MM-DiT for Image and Video Editing

Abstract: Multimodal Diffusion Transformers (MM-DiTs) have recently emerged as a powerful framework for unified text-vision synthesis, surpassing traditional U-Net architectures in generative tasks. One key innovation lies in its Multimodal Self-Attention (MM-SA) interaction, where image and text tokens are concatenated and processed via self-attention. However, this mechanism poses significant challenges for editing, rendering conventional U-Net-based attention manipulation methods ineffective. To address this limitation, we propose QK-Edit, a training-free framework that exploits the unique attention dynamics of MM-DiTs for precise text-guided image and video editing. By introducing a novel query-key manipulation strategy, our method isolates and adjusts critical attention components to achieve an optimal balance between prompt fidelity and structural consistency. This enables seamless edits across various tasks, including object addition, object removal, object replacement, changing background, changing material, changing color, and style transformation. Notably, it can be easily implemented with feature replacement in inference. QK-Edit demonstrates superior editing performance on state-of-the-art models, such as FLUX and HunyuanVideo, effectively bridging the gap between generative power and editable flexibility in MM-DiTs, and paving the way for scalable multimodal content creation.

Tue 13 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Editing images and videos guided by text has gotten better with new transformer-based models that combine text and vision. But these models have made traditional editing tricks less effective. The authors introduce QK-Edit, a method that tweaks how attention works inside the model to make precise edits based on text without retraining. This helps add or remove objects, change colors, and alter styles smoothly in both images and videos.
Open → 2610.17829v1

Visual artifact editing benchmark compares pixels code and agents

Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operation

Abstract: Visual artifacts such as charts, technical diagrams, webpages, and document pages underpin scientific, commercial, and engineering workflows. Editing these artifacts requires direct modification, dependency-aware updates, preservation of unaffected content, and compliance with domain constraints. We define this capability as Visual Artifact Operation (VAO). Prior benchmarks test parts of this problem, including cascading updates in charts. We study direct edits, dependent updates, and preservation across visual domains and pixel, code, and agent paradigms under one image-only protocol. We introduce Visual Artifact Operation Bench (VAO-Bench), comprising 1,573 manually screened tasks across nine artifact categories and three difficulty levels. VAO-Bench uses executable artifacts and deterministic rendering to trace reference transformations and annotate direct edits, dependent updates, and preservation constraints. All systems receive the same source image and instruction; we evaluate pixel-space editors, code-generating multimodal systems, and tool-using agents on direct-edit accuracy, dependency-aware update, content preservation, domain validity, and visual quality. Experiments show that executable-code systems better support dependent updates, while pixel-space editors offer faster execution and strong visual quality. Explicitly stating dependencies improves both paradigms, identifying implicit-update inference as a central bottleneck. VAO-Bench provides a reproducible foundation for dependable visual artifact editing across generation paradigms.

Mon 12 OctComputer Vision and Pattern Recognition
The gist
Editing images like charts or webpages is tricky because changes in one part can affect other parts. The authors introduce a new benchmark called VAO-Bench that tests different ways to edit these images, including using pixel-based tools, code generation, and agent systems. They found that code-based methods are better for handling dependent changes, while pixel editors run faster and look good. The benchmark helps understand how well each method manages direct edits, updates, and keeps everything looking right.
Open → 2610.16444v1

Depth guided method improves seamless image self-tiling quality

DepthTile: Depth-Guided Existing-Image Self-Tiling with Input-Side Tileability Assessment

Abstract: Existing-image self-tiling aims to transform a given image into a seamlessly repeatable tile while preserving its original semantics and local details. This task requires weak editing to retain the source but leave periodic seams, whereas strong editing improves tileability at the large risk of content drift.Existing diffusion-based tiling pipelines alleviate boundary discontinuities, yet lack awareness of which regions are geometrically important to preserve. In this work, we propose DepthTile, a depth-guided self-tiling method whose generation module requires no retraining of the diffusion backbone. It converts monocular depth into a spatial preservation prior and integrates it into the timestep-dependent masking mechanism of Tiled Diffusion. DepthTile converts depth into a spatial editability map and fuses it with the differential diffusion mask. This strengthens source preservation in near-field regions indicated by the monocular depth prior while retaining editing flexibility near compatible background boundaries. To access when self-tiling is feasible, we introduce the Self-Tiling Ability Score (STAS), a lightweight input-side predictor based on RGB, gradient, depth, and depth-gradient cues. On a 335-image benchmark, relative to the default Tiled Diffusion pipeline, DepthTile reduces MAE, LPIPS, and Tiling Score by 12.8%, 26.7%, and 8.4%, respectively. STAS reliably enables difficulty-aware analysis and further supports compatibility-aware pairwise image tiling.

Mon 12 OctComputer Vision and Pattern Recognition
The gist
Making an image repeat perfectly as a tile without obvious seams is tricky because changes can distort important parts. The authors introduce DepthTile, which uses depth information from a single image to know which areas to protect and which can be edited. This helps keep important objects sharp while making the image tile seamlessly. They also created a quick way to predict if tiling will work well for a given image.
Open → 2610.16278v1

Unified vision language models improve text image and image text generation

Understanding Unified VLMs: From Attention Probing to Guidance Tuning for Multimodal Generation

Abstract: Unified vision-language models (VLMs) perform both text-to-image (T2I) and image-to-text (I2T) generation with one shared Transformer backbone, yet how the backbone processes the condition in either direction remains poorly understood. We study this question from the perspective of conditional guidance: we probe every attention head to show the activation difference between two branches of classifier-free guidance (CFG) with different conditional guidance. On two unified VLMs of autoregressive and masked-diffusion paradigms, the probing reveals a subset of heads that are more sensitive to the change of condition while others are agnostic to it. This characteristic pattern holds in both T2I and I2T generation and is largely stable across data samples, demonstrating the internal mechanism of unified VLMs. Motivated by this, we propose a new inference-time intervention approach for unified multimodal generation, named \textit{HeadTuned-CFG}, which uses the probed condition-change awareness to select and tune the conditional guidance at the attention-head level. Experiments show consistent benefits in both multimodal generation directions of unified VLMs without additional training, and in particular substantial improvements over strong baselines in T2I generation. These results further support the key finding of our probing analysis: the observed pattern of functional specialization is an intrinsic property of unified VLMs.

Sat 10 OctArtificial Intelligence
The gist
Unified vision-language models can both create pictures from words and describe images in words using one shared system. The authors studied how different parts of this system focus on the input in each case. They found certain parts, called attention heads, are more aware of the input change, and others are not. Using this, they invented a method to tune these parts during generation, improving results without retraining the model.
Open → 2610.15227v1

SpatialCritic improves rewards for better image generation with curriculum learning

Getting Space Right: Agentic Rewards for Image Generation

Abstract: Reinforcement learning (RL) is promising for spatial text-to-image generation, but existing work largely focuses on policy optimization, assuming accurate rewards and effective online rollouts. We observe in-domain gains with out-of-domain degradation, exposing two limitations: unreliable spatial rewards in open-world settings and rollouts lacking basic-to-complex progression. We propose a curriculum-guided RL framework. First, we introduce SpatialCritic, an agentic reward model equipped with a spatial perception harness that combines reusable verification guidance with specialized vision tools. We then construct spatial preference datasets through targeted counterfactual perturbations and perform agent-harness alignment to improve tool selection and evidence integration efficiently. Second, curriculum learning organizes shared foundational capabilities and their compositional dependencies in a capability graph for mastery-guided rollouts, periodic review, and targeted remediation. On SpaRW-Eval, SpatialCritic achieves 95.1% verification accuracy, outperforming 320B GLM-5.3-Flash with a 40x smaller 8B backbone and raising average baseline scores from 78.4 to 83.9 on SD3.5-Medium and 83.2 to 86.5 on BAGEL. Project page: https://xiaofeng-tan.github.io/projects/spatialcritic/

Sat 10 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Generating images from text can be tricky when the image needs to match spatial instructions, like placing objects in the right places. The authors found that earlier methods struggled because they assumed rewards and feedback were accurate and progressive, which isn’t always true in real-world settings. They designed a new system called SpatialCritic that uses special visual tools to check spatial details accurately and learns through a step-by-step curriculum to improve results over time. This makes image generators better at following spatial cues in their outputs.
Open → 2610.14852v1

Japanese handwriting generation improves with human preference feedback

Japanese Handwriting Generation Based on Human Preference Feedback Using Direct Preference Optimization

Abstract: We propose a Japanese handwriting generation framework that integrates human preference feedback using Direct Preference Optimization (DPO) to align generative models with human cognitive and stylistic preferences. While font generation technologies leveraging Generative Adversarial Networks and diffusion models have advanced significantly, applying these approaches to handwriting generation presents unique challenges. Font generation is a deterministic process yielding consistent styles. Handwriting generation, on the other hand, is inherently non-deterministic. In handwriting, glyph shapes never match exactly even when the same writer writes the same character. We define this shape difference as handwriting variability. Although this variability is essential for conveying the natural quality of human writing, it complicates model training and substantially increases data collection costs to capture diverse distribution patterns. To address these limitations, we incorporate human perceptual feedback into the training loop of handwriting generation. While collecting extensive handwritten data is costly, evaluating pairwise preferences between two generated samples remains very easy for humans. Applying DPO, an efficient RL-free preference optimization method, to our generation model enables high-quality handwriting generation without relying on large-scale dataset collection. Experimental results across four distinct Japanese handwriting styles demonstrate that DPO-based training enhances overall structural accuracy. However, in highly complex styles with significant variability, such as brush pen writing, the model fails to capture style-specific features. These findings highlight a critical challenge in extending DPO to complex handwriting styles.

Sat 10 OctComputer Vision and Pattern Recognition
The gist
Generating Japanese handwriting that looks natural is hard because no two handwritings are exactly alike, even from the same person. The authors created a method that asks people which handwriting samples they like better to teach a computer model to generate more preferred handwriting. This approach doesn’t require huge amounts of handwriting data and still improves how accurate and natural the computer-generated handwriting looks. However, very complex styles like brush pen strokes remain a challenge for the method.
Open → 2610.14743v1

Slideredit++ enables smooth control for better image editing sliders

SliderEdit++: Improved Slider Trajectories in Instruction-Based Image Editing

Abstract: Slider-based control aims to give users continuous, fine-grained control over the intensity of individual edits in instruction-based image editing. However, existing approaches fail to deliver reliable continuous controllability: traversing a slider can produce abrupt visual jumps and non-monotonic changes, while jointly controlled sliders can interfere with one another. To systematically study these limitations, we introduce SlideBench, a comprehensive benchmark for continuous image editing spanning diverse editing categories and equipped with a unified suite of metrics quantifying monotonic progression, perceptual continuity, and inter-slider disentanglement. Building on these observations, we propose SliderEdit++, which explicitly regularizes the intermediate editing trajectory rather than supervising only its endpoints. Our method combines velocity- and semantic-space trajectory regularization with spectral control to encourage smooth, predictable slider traversal, together with a disentanglement objective that reduces interference between independently controlled edits. On SlideBench, SliderEdit++ achieves state-of-the-art performance, improving the overall score by 18.5% relative to the strongest baseline. At the same time, using a few-step editing backbone makes our method approximately 3x to 20x faster than existing slider-based approaches, enabling substantially more responsive interactive editing.

Fri 9 OctComputer Vision and Pattern RecognitionGraphics
The gist
Sliders let people change how much an image edit affects a photo, but current sliders can jump suddenly or mess up when used together. The authors created a set of tests called SlideBench to measure these problems and then improved the sliders with a method called SliderEdit++. This new approach makes slider movements smoother and more predictable, preventing edits from interfering with each other. Their technique also runs much faster than older methods, making image editing more responsive.
Open → 2610.14253v1

Emotion editing method adjusts images to match target feelings precisely

What We Talk About When We Talk About Emotion Editing

Abstract: Emotional image editing aims to change the emotion a scene conveys while preserving its essential content. Because the same scene can support different emotional interpretations, achieving an emotional goal requires visual changes grounded in the source context. Motivated by the Component Process Model, which links emotional responses to event appraisal, we investigate neural representations as a reference for these editing decisions. Using TRIBE v2, an fMRI encoding model, we analyze 400 source-target pairs across eight emotion categories. Hidden states from EmoEdit, EmoEditor, and AffectDelta correspond more strongly to predicted target-image responses in visual regions than in affect-related regions. This imbalance motivates ROI-ReFT, which combines source visual responses as a content reference with a predicted affective response change as an editing direction. Two interacting branches use both conditions to guide a frozen editor throughout generation. Predicted responses of the generated image supervise affective change and constrain visual drift. On a post hoc selected subset of 400 editing requests, ROI-ReFT achieves 91.75% target-emotion accuracy and 83.25% joint success, with the same output both matching the target emotion and reaching source-output DINO-I of at least 0.80. Our code and dataset will be publicly released.

Fri 9 OctComputer Vision and Pattern Recognition
The gist
Changing the emotion an image shows is tricky because the same scene can feel many ways. The authors studied how brain-based models predict what feelings an image gives and used this info to guide image editing. They created a new method that keeps the important parts of the picture while changing its emotion accurately. This method was tested on hundreds of examples and showed it could often make the edited image feel the intended emotion without losing the original content.
Open → 2610.13558v1

Text to image AI models bias toward clocks showing 10 10 time

It's Always 10:10: Reference Images Break a Bias That Prompts Only Dent

Abstract: Text-to-image models appear to reproduce the habits of the photographs they learned from. Analog clocks are an extreme case: in advertising, watches almost always show 10:10, and generated clocks return to 10:10 even when another time is requested. We measure this bias and test three ways of overcoming it on 52 models available on the Magnific platform, with a replication on Higgsfield. Every image shows three identical clocks that must show 2:35, 6:50 and 11:20. The description of the object is fixed and only the request about the time changes: no time (A), the time in digits (B), the hand positions described by construction relative to the dial numerals (C), or the same description plus a drawn reference dial (D). Two AI readers read all 1,799 images blind from coded copies, with a third reader and the author settling disagreements (dial-level agreement 96.0% and 97.3%). With no time requested, 67% of the images have all three clocks at 10:10. On the 20 current models, all three clocks are correct in 34% of the images with digits, 30% with the hands described in words and 75% with the reference dial (D-B: +37 points, 95% CI +28 to +45); we found no evidence that describing the hands in words beats the digits (C-B: -4 points, CI -10 to +1). The replication on the 12 models shared by both platforms gives the same picture (B 54%, C 50%, D 81%). Writing the time reduces the bias but leaves two thirds of the images of the 20 current models with at least one wrong clock; adding a drawn reference raises full accuracy to three quarters and almost eliminates images entirely at 10:10. We release all images, prompts, raw readings and a script that recomputes every result.

Thu 8 OctComputer Vision and Pattern RecognitionHuman-Computer Interaction
The gist
AI models trained to generate images often repeat common patterns seen in their training pictures, like clocks showing the time 10:10. This study shows that no matter what time you ask for, these models often default to 10:10, which is a common clock time in advertisements. The authors tested ways to reduce this bias by giving the AI clearer instructions and pictures, finding that adding a drawn reference clock helps the model show the correct times much more often. This improves accuracy and reduces the repeated 10:10 default.
Open → 2610.11320v1

Logo design improves with original design space sampling method

DOGS: Design-Space Sampling for Prompt-Driven Logo Generation

Abstract: Prompt optimization for text-to-image (T2I) generation has been pursued almost entirely as text rewriting, in which a short user brief is expanded into a longer, model-preferred token sequence. We argue that such a language-space formulation is ill-suited to structured visual design tasks such as logo creation, where a one-line brief leaves most design decisions unspecified. These decisions depend on relational priors that a linear sequence cannot encode, and they leave an uncontrolled channel through which protected marks may be reproduced. We therefore recast logo prompting as sampling within a structured design space, and instantiate this idea as DOGS (Design-space prompting with an Originality-aware GFlowNet Sampler). From a large corpus of real-world logos, we mine a typed, graph-structured design grammar whose edges record empirical co-occurrence. A GFlowNet sampler then generates design graphs with probability proportional to a terminal reward that combines recognizability, aesthetics, and corpus-relative originality. Every slot draws only from a closed design-level vocabulary, and any infringement-inducing or harmful token is removed during parsing. The originality reward further penalizes proximity to existing logos, thereby incorporating infringement avoidance into the method by construction. On two open-source renderers and against nine baselines, DOGS produces logos that are more recognizable and aesthetic, substantially more diverse, and far less prone to trademark infringement.

Wed 7 OctComputer Vision and Pattern Recognition
The gist
Creating logos based on short text descriptions often misses important design details and risks copying existing trademarks. The authors developed a method called DOGS that treats logo design as building graphs from a set of design parts, guided by a network that favors originality, aesthetics, and recognizability. This approach avoids copying known logos by penalizing similarities and keeps the design choices structured rather than just a line of text. Testing showed DOGS generates logos that look better, are more unique, and less likely to infringe trademarks compared to other methods.
Open → 2610.10760v1

Diffusion models learn to generate images matching personal user preferences

Personalize at Test Time: Learning User Preferences for Image Generation

Abstract: Diffusion models can generate high-quality images, yet aligning their outputs with individual user preferences remains challenging. A key bottleneck is accurately modeling diverse user preferences from limited feedback. Existing approaches often rely on labor-intensive manual preference annotations or vision-language models (VLM) to extract preference information from user interaction histories, introducing substantial annotation or computational costs that limit scalability. We propose an approach that learns personalized reward models directly from users' historical image preference pairs. First, we use an autoencoder to compress hundreds of visual attributes into 50 attribute-anchored preference dimensions and train an evaluator to score images along these dimensions. We then represent each user's preferences as a linear combination of the shared dimension scores, estimating the user-specific weights by maximizing the likelihood of their observed pairwise preferences under the Bradley-Terry model. This formulation reduces per-user adaptation to optimizing a low-dimensional weight vector, simplifying optimization and enabling data-efficient personalization from sparse feedback. The learned personalized rewards guide image generation at inference time while keeping the diffusion model frozen. Experiments on real-user preference data show that our approach achieves approximately 77% held-out pairwise preference prediction accuracy and improves the alignment of generated images with individual user preferences.

Tue 6 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Generating images that match what different people want is hard because everyone likes different things. The authors created a way for a computer to learn what each person prefers just by looking at the pairs of images people say they like more. They shrink lots of image details into a smaller set of traits, then figure out how each user weighs these traits to pick their favorite. This helps the computer make pictures a user will like without retraining the whole system every time.
Open → 2610.09015v1

Refroute cuts cost and speeds up many-reference image generation

RefRoute: Decoupling Conditioning Cost from References via Compact Residual Conditioning and Spatial Routing

Abstract: Multi-reference image generation requires preserving the appearance of multiple subjects while composing them into a coherent scene. However, existing diffusion transformers commonly encode references as dense visual token grids and jointly process them with global attention, making conditioning increasingly expensive as the number and resolution of references grow. We present RefRoute, a framework that addresses both reference representation cost and attention overhead through two complementary mechanisms. Compact residual conditioning combines low-resolution latent tokens with lightweight residual features extracted from full-resolution pixels, reducing reference token counts while retaining fine-grained appearance cues. Condition routing and attention routing align reference tokens with their assigned target regions and restrict cross-reference interactions, while allowing selective reference access beyond region boundaries for scene integration. We further introduce RefRoute-Data for training many-reference generation models and ManyRef100, a benchmark spanning human, object, and mixed compositions with 10-17 references. After many-reference fine-tuning, RefRoute achieves an overall Weighted-Ref-VIEScore of 36.06 on ManyRef100, compared with 8.88 for FLUX.2-Klein-9B. Separate inference-cost evaluations show substantially slower latency growth as the reference count increases: at 16 references, our 50-step and 4-step configurations achieve $18.3\times$ and $14.2\times$ speedups over their corresponding FLUX baselines, respectively. These results establish compact reference representations and spatially routed attention as an effective approach to scalable many-reference image generation.

Tue 6 OctComputer Vision and Pattern RecognitionMachine Learning
The gist
Creating images that combine many different subjects often slows down because computers must carefully handle lots of detailed visual information. The authors introduce RefRoute, a method that smartly reduces how much visual data the model looks at by using low-resolution tokens plus small extra details from full-sized images. It also directs attention only to relevant regions, avoiding extra work when combining parts. Their tests show this approach generates complex images with many references much faster and with better quality than previous methods.
Open → 2610.07720v1

Frequency aware diffusion models improve personalized image style and color transfer

Disentangling Dual Image References in Frequency Aware Diffusion Models for Personalized Generation

Abstract: Personalized image generation aims to synthesize text-driven images conditioned on reference images, while mainly casting the generation as image customization for foreground and style transfer for background. Previous arts of diffusion models suffers from the text misalignment with background for image customization and foreground for style transfer during the denoising process. Such facts, as we observed, rooted from the entanglement among hybrid frequency bands during the denoising process. To address such salient limitation, in this paper, we study personalized generation based on dual references - customization and color and style reference - and propose a paradigm to disentangle these Dual image references within Frequency-aware Diffusion Models, dubbed Dual-FDM, to simultaneously tackle two crucial personalized image generation tasks: customization style transfer and color style transfer, by disentangling different frequency bands via mask strategy within frequency domain. For customization style transfer, we replace the mid-frequency band of the background in the style reference with that from the foreground of the customized reference. For color style transfer, we substitute the low-frequency band of the background in the style reference with that from both the foreground and background of the color reference. Both the substituted frequency bands are used as the key and value to reconstruct the query foreground and background of the denoised personalized image.Extensive experiments validate the superiority of Dual-FDM over the state-of-the-art diffusion models for personalized image generation. Our code can be accessed from https://github.com/htyjers/Dual-FDM.

Tue 6 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Generating personalized images by combining text and reference photos can be tricky because different parts of the image (like foreground and background) get mixed up during the creation process. The authors found that this problem happens because of how different detail levels (frequency bands) are combined. They made a method called Dual-FDM that separates these detail levels to better handle two tasks at once: changing the style of certain parts and transferring colors correctly. Their approach improves the quality and accuracy of personalized images compared to earlier methods.
Open → 2610.07684v1

Uniform sliders improve continuous image editing experience

UniSlider: Perceptually Uniform Sliders for Continuous Image Editing

Abstract: Sliders provide an intuitive interface for continuous image editing. In current generative approaches, however, the slider is simply a rescaling of the method's strength parameter, such as an adapter coefficient, a prompt weight, or an interpolation factor. This strength relates poorly to perceptual change. The image can partially revert as the slider moves, long stretches of the range produce no visible difference, and short intervals transform the image abruptly. Remapping the strength could fix this uneven pace, but only if the trajectory is monotone, which current methods do not enforce. We therefore distinguish the slider from the strength, and require perceptual distance from the input to grow linearly with the slider value. We introduce UniSlider, a lightweight LoRA trained on a few-step editing backbone so that its strength approximates this ideal slider. Few-step sampling lets us impose this objective in pixel space without intermediate ground truth, and the backbone's output is preserved at full strength. However, a low-rank adapter cannot make the strength fully uniform. Our slider is thus an inference-time remapping of the strength, obtained by adaptive sampling. Since training optmizes to make the trajectory monotone, this remapping closes the remaining gap without extra training or parameters. On a new benchmark of 300 continuous edits evaluating uniformity, monotonicity, edit fidelity, and identity preservation, UniSlider outperforms all prior methods and is preferred in a user study.

Mon 5 OctComputer Vision and Pattern RecognitionArtificial IntelligenceGraphics
The gist
Adjusting images with sliders often leads to uneven changes, where the picture might barely change in some parts and suddenly shift a lot in others. The authors created UniSlider, a new kind of slider that changes images smoothly and evenly according to how humans perceive differences. They do this by training a special tool that makes the image changes grow steadily as you move the slider. Their tests show UniSlider works better than older methods and is easier for people to use.
Open → 2610.06831v1

Diffusion method improves style transfer while keeping content intact

TRACE: Time-Adaptive Residual Attention Control with Content-Style Decomposition for Training-Free Diffusion Style Transfer

Abstract: Reference-guided style transfer aims to preserve the semantic structure of a content image while transferring the visual appearance of a style reference. Recent diffusion-based methods achieve impressive stylization quality by exploiting strong pretrained generative priors. However, training-free approaches still face a difficult trade-off among style fidelity, content preservation, and content leakage. Direct style injection may unintentionally transfer semantic content from the style image, while fixed guidance schedules often ignore the time- and state-dependent nature of diffusion sampling. To address these limitations, we propose TRACE, a training-free diffusion style transfer framework with Time-adaptive Residual Attention Control and Content-Style Decomposition. TRACE first performs offline CLIP-based subspace analysis to separate content and style directions from paired data. During inference, it removes content-related components from the style reference and style-related components from the content reference to reduce leakage. It then injects style information through residual cross-attention and applies uncertainty-aware guidance to adapt the guidance signal at each denoising step. Experiments show that TRACE achieves a favorable trade-off between stylization and preservation. Compared with optimal-control-based baselines, TRACE substantially improves style fidelity (+17.28 CSD and +34.10 SRA). While, compared with stylization methods, it better preserves content structure (+12.80 DINO, +5.52 CLIP-I, and -8.19 LPIPS) and reduces directional semantic leakage by 29.5% in DCL. Our code is publicly available at https://github.com/pixelchemy-research/TRACE.

Sun 4 OctComputer Vision and Pattern Recognition
The gist
Style transfer means changing the look of a picture while keeping its main objects recognizable. Existing diffusion methods that do this often struggle to balance copying style properly without mixing up the details from the style image or losing the original content. The authors introduce a new technique called TRACE that carefully separates the style from content using a special analysis and adjusts the process dynamically during image creation to avoid mix-ups. This makes the style transfer look more faithful to the style while keeping the original image’s structure clearer.
Open → 2610.04922v1

Sphere Encoder 2 improves image generation quality and speed

Sphere Encoder 2

Abstract: Sphere Encoder is an autoencoder that generates images by decoding random points from a high-dimensional latent sphere. We identify two limitations of the original formulation that reduce its generation quality. First, random points concentrate near the equator relative to the pole on an encoded latent, but the training rotation never reaches this region, leaving a gap that limits one-step generation. Second, training for generation with pixel-wise reconstruction loss encourages the decoder to average over plausible images, producing blurry images that lack high-frequency details. We present Sphere Encoder 2 to address both limitations, substantially improving image generation quality while maintaining the speed and simplicity of a autoencoder. Models are released at \href{https://github.com/kaiyuyue/sphere2}{github.com/kaiyuyue/sphere2}.

Thu 1 OctComputer Vision and Pattern Recognition
The gist
Generating images from random points inside a sphere is tricky because points tend to cluster away from the poles, creating gaps in those areas. Also, the original method tries to make images match pixel-for-pixel, leading to blurry results. The authors fixed these problems by adjusting how the model trains and where it samples points, which makes it create clearer images faster.
Open → 2610.02208v1

AI agent improves control over positive and negative space in images

Form and Void: Entangled Composition through an Autonomous AI Agent

Abstract: Positive and negative space is a fundamental principle in visual composition, supporting visually coherent forms and layered semantic relationships. Generating such compositions is challenging because it requires coordinated control over two semantic concepts that share a common boundary. Although recent text-to-image models and multimodal large language models (MLLMs) have achieved strong performance in image generation and visual understanding, positive-negative space generation remains difficult, particularly under direct single-pass prompting. In this work, we present the \textbf{F}orm \textbf{a}nd \textbf{V}oid \textbf{A}gent (\textbf{FaV-A}), a multimodal agent designed for staged positive-negative space generation. FaV-A follows a progressive workflow: it first generates a base object, then analyzes its shape and spatial structure to identify candidate negative-space semantics, and finally produces compositional instructions for the final image generation stage. Experimental results and ablation analyses suggest that FaV-A provides a more effective framework than direct zero-shot MLLM baselines for producing visually coherent and semantically aligned positive-negative space compositions.

Thu 1 OctComputer Vision and Pattern RecognitionMultiagent Systems
The gist
Creating images that balance objects and the spaces around them is hard because both parts need to fit together nicely. The authors designed an AI agent called FaV-A that makes this easier by first drawing the main shape, then looking at it to find meaningful empty spaces, and finally giving instructions to complete the image. Their tests show this step-by-step approach works better than trying to do it all at once with existing AI models. This helps make pictures that look better and match their meanings more closely.
Open → 2610.02045v1

Continual personalization of image models with fixed size adapters

CLASP: Continual Low-rank Adapters for Spatially Placed Concepts from One Hypernetwork

Abstract: Continual personalization of text-to-image diffusion models requires sequentially acquiring new concepts while retaining previously learned ones. However, existing methods either suffer from catastrophic forgetting or rely on storing additional concept-specific parameters and spatial components, causing their parameter footprint to grow with the concept stream. This limits their ability to scale to long sequences of personalization tasks. We propose a rehearsal-free approach that uses a single fixed-size hypernetwork to continually personalize a frozen diffusion model. Instead of expanding the model as new concepts are acquired, the hypernetwork dynamically produces the concept-specific adaptations required for personalization while preserving previously learned concepts. Our framework further integrates spatial control into the personalization process, allowing users to specify where a personalized concept should appear without introducing additional per-concept components. This formulation enables continual personalization with a parameter footprint that remains independent of the number of learned concepts, aside from compact concept representations. Experiments demonstrate strong retention of previously learned concepts and reliable spatial grounding, matching or improving upon existing methods while scaling effectively to long streams of personalization tasks.

Thu 1 OctComputer Vision and Pattern Recognition
The gist
Personalizing image generation models with new concepts usually means the models forget old ideas or need more space to remember everything. The authors propose a new way to keep teaching a model new things without forgetting the old ones and without making the model bigger. They do this by using a special small network that creates customized tweaks for each new concept while keeping everything else unchanged. This also lets users place the new concepts exactly where they want in the image.
Open → 2610.01331v1

Text to image models better preserve subject look with regain correction

ReGain: Restoring Subject Fidelity in Personalization on Synthetic Images

Abstract: Text-to-image diffusion models are personalized to a subject by DreamBooth fine-tuning on a handful of its images. Increasingly, these images come from a diffusion model rather than a camera. We show that fine-tuning on such synthetic images degrades subject fidelity, producing oversaturated color and excess high-frequency detail. To isolate the cause, we fine-tune two models from the same base model with the same DreamBooth recipe, one on real photos of a subject and one on synthetic images of that subject generated by the first. We trace the degradation to classifier-free guidance (CFG). For the model personalized on synthetic images, the angle between the conditional and unconditional noise predictions, and with it the norm of their difference, is much larger than for the model personalized on real photos. This inflation grows toward high frequencies and also appears at other prompts semantically close to the subject, such as its class noun, but not at unrelated ones. We propose ReGain, a training-free correction applied at sampling time that measures how much each frequency band of the guidance is inflated relative to the base model and scales that band down accordingly. ReGain needs no real photos. On Stable Diffusion v1.5, ReGain closes 51-64% of the subject-fidelity gap to the model personalized on real photos, as measured by DINO, DINOv2 and CLIP-I. It also improves subject fidelity on SDXL and SD 3.5 and preserves text alignment on all three backbones.

Wed 30 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceMachine Learning
The gist
Text-to-image AI tools are often customized using a few pictures of a person or object, usually taken with a camera. But sometimes these pictures come from the AI itself, which leads to weird colors and too much detail in the final images. The authors pinpointed the problem to a specific step in the AI's image generation called classifier-free guidance. They created ReGain, a fix that adjusts these details during image creation to make the AI-generated images look more like the real subject, without needing any real photos.
Open → 2609.38680v1

Scene text editing that keeps original font colors and style

STEPS: Scene Text Editing with Preserved Style Using Diffusion and Contrastive Style Encoding

Abstract: We introduce Scene Text Editing with Preserved Style (STEPS), a novel diffusion model architecture for quality text replacement in images. Scene Text Editing (STE), also known as Visual Text Editing, consists of changing the textual content in an image while conserving the original style, e.g. font, colors, orientation, background, etc. STEPS advances the state of the art in STE through directed focus on improved style preservation. We introduce a style encoder for visual text that captures style independently of textual content, and a model architecture that combines the style encoder with multiple semantic conditions (target text characters encoding and rendered glyphs). STEPS achieves superior results to previous STE methods in style preservation, output readability, and subjective quality.

Tue 29 SeptComputer Vision and Pattern RecognitionMachine Learning
The gist
Changing text in pictures while keeping the same look is hard. The authors created STEPS, a new method that changes words in images but keeps the style, like font and colors, unchanged. They made a special tool to understand the style separately from the letters, helping make the changed text look natural. Their method works better than older ones in keeping style, being easy to read, and looking good.
Open → 2609.38636v1

Modal kinetic typography animates letters with smooth, meaningful motion

Strike a Chord! Modal Kinetic Typography

Abstract: We introduce modal kinetic typography, which animates a vector glyph to express a semantic concept while keeping it legible. Our key idea is to build motion from the glyph's natural vibration modes. Specifically, a finite-element eigenproblem assembled from the vector outline yields the glyph's softest modes, for the whole letter and for each of its parts, allowing it to bend. The problem's zero-energy solutions, i.e., rigid translations and rotations, are applied in closed form to each part, allowing parts to also move as blocks. To animate the glyph, a frozen video diffusion model supervises only the modes' amplitudes and phases. Our modal approach addresses two weaknesses of prior work. Free-form point optimization under video score distillation (SDS) moves each point and frame independently along noisy gradients, tearing the outline and causing jitter. In contrast, our modes are smooth along the outline and driven by a few whole-cycle harmonics, which restricts these gradients to smooth, seamlessly looping motion. On the other hand, structured alternatives rely on skeletons or keypoints from category-specific priors, whereas our modes come from the glyph itself; the only prior is a list naming each letter's moving parts, generated once for the whole alphabet by a language model. In modal kinetic typography, shape and motion are disentangled by construction: a single base outline is sculpted toward the concept, and the modal drive cannot alter it, so a letter can also be animated without being reshaped. Our method produces more articulated and smoother motion than Dynamic Typography and AniClipart at comparable or better concept alignment, with less glyph tearing than Dynamic Typography, and is preferred by human raters, including in a frozen-shape setting where motion alone must carry the concept. Our results were also preferred over Astra (GPT-6) by human raters.

Tue 29 SeptComputer Vision and Pattern RecognitionGraphics
The gist
Animating letters to show meaning often causes shaky or broken shapes. The authors created a new way to animate letters using their natural bending patterns, keeping them smooth and readable. Their method uses a physics-based model to move parts of each letter in coordinated ways, guided by a video model that matches the animation to a concept. This approach produces clearer, more natural movements than earlier methods and was preferred by people when tested.
Open → 2609.38325v1

Adversarial training improves fine details in pixel image generation

Adversarial Training for Pixel Diffusion

Abstract: Pixel diffusion models generate RGB images directly, avoiding the bottleneck of an autoencoder, yet their outputs still systematically underrepresent fine-scale natural-image statistics. We show that adversarial learning provides an effective post-training correction for this deficiency. Starting from a pretrained model, we retain its original diffusion or flow-matching objective and add an adversarial loss to the predicted output at non-high-noise timesteps, leaving the model architecture and sampling procedure unchanged. To our knowledge, this is the first systematic study of adversarial post-training for pixel diffusion. Across two pixel backbones, the method jointly improves distribution fidelity, coverage, prompt alignment, and perceptual quality. We further investigate why it works. Frequency-band and power-law analyses show that the original models systematically underproduce natural-image high-frequency content, while adversarial post-training restores this missing spectral power. In contrast, perceptual loss also increases high-frequency content but sacrifices distribution fidelity and prompt alignment. Nearest-neighbor, recall, and matched no-GAN SFT controls further rule out memorization, mode dropping, and additional optimization as simple explanations. Finally, we examine the boundary of this effect. Under the tested latent diffusion configurations, the same procedure does not produce comparable joint gains and adds almost no decoded high-frequency power. These results identify direct output access to the image statistics being corrected as a key factor governing when adversarial post-training succeeds.

Tue 29 SeptComputer Vision and Pattern Recognition
The gist
Pixel diffusion models can create images by predicting pixels directly but often miss fine details seen in real photos. The authors show that adding adversarial training after initial training helps these models produce sharper and more natural textures without changing how they generate images. This method fixes missing high-frequency details important for realism, unlike other approaches that add noise or lose alignment with the image description. The improvement works well when the model directly outputs the image pixels, but not when using compressed forms.
Open → 2609.38170v1

Style transfer method reduces content leakage while keeping style intact

CLeaR: A Unified Framework for Resolving the Leakage-Degradation Dilemma in Style Transfer

Abstract: Style transfer aims to render target content in the style of a reference image, but existing methods often suffer from content leakage, where objects, layouts, or semantics from the style reference appear in the generated output. Although prior data-driven and training-free methods can reduce leakage, they often face a leakage-degradation dilemma: stronger content suppression may weaken style fidelity, while richer style preservation may reintroduce unwanted reference content. We identify this dilemma across the full style-transfer pipeline, including feature separation, feature-space grounding, and diffusion generation. To address these issues, we propose CLeaR, a training-free framework for content-leakage-resistant style transfer. CLeaR first uses Orthogonal Subspace Projection to define content-reduced style targets in each vision foundation model (VFM) feature space. It then performs Ensemble Inversion, which optimizes a shared pixel-space style anchor satisfying style constraints across multiple VFMs. Finally, Energy-Guided Calibration maintains style alignment during diffusion sampling by steering the denoising trajectory toward the ensemble-defined style manifold. We further provide a theoretical analysis showing that the style-anchor estimation error decreases with the number of VFMs. Experiments on StyleBench demonstrate that CLeaR improves style alignment, reduces content leakage, and achieves better LLM-as-Judge evaluation compared with existing methods. The code is available at \href{https://github.com/0606zt/CLeaR}{https://github.com/0606zt/CLeaR}.

Tue 29 SeptComputer Vision and Pattern Recognition
The gist
Style transfer tries to make a picture look like it's painted in the style of another image, but often bits of the original picture sneak through, making the final image look messy. The authors found that pushing too hard to remove these bits often ruins the style, and trying to keep the style strong brings back unwanted content. They created a new method called CLeaR that balances this by carefully separating content and style using multiple image analysis tools without extra training. This approach results in better style matching and less leakage in the generated images.
Open → 2609.38136v1

Fine grained rewards improve Chinese text rendering in AI images

Decompose Radicals, Then Reward: Fine-Grained Inspection for Accurate Chinese Text Rendering

Abstract: Rendering accurate Chinese text remains challenging for text-to-image models. Existing OCR-based reinforcement-learning rewards compare decoded transcripts with target strings. Such rewards overlook the compositional nature of Chinese writing: an ideograph consists of reusable components arranged through explicit spatial relations, yet OCR evaluates it as an atomic character. Consequently, visually different radical-level errors may receive equally coarse feedback, encouraging glyphs that merely resemble the target instead of faithfully reproducing its internal structure. We employ Ideographic Description Sequences (IDS), which comprise spatial operators and character components, and train an expert IDS recognizer to transcribe rendered Chinese text into this representation. Building on this recognizer, we introduce IDSpect, which deterministically decomposes the target text into IDS tokens and aligns crop-level visual IDS predictions with the target sequence. Globally unique token credit makes this comparison robust to the order of detected text regions. Combined with a whole-character semantic reward, IDSpect supplies fine-grained credit with component and spatial-relation without changing the image generator or adding inference-time cost. Experiments with GRPO post-training of Qwen-Image demonstrate that IDSpect achieves leading structural quality and semantic alignment on LongText and GenTextEval.

Tue 29 SeptComputer Vision and Pattern Recognition
The gist
Generating clear and accurate Chinese text with AI images is hard because Chinese characters are made of smaller parts arranged in complex ways. Current methods treat each character as a whole and don’t check these parts carefully, so the AI might guess characters that look similar but are not correct inside. The authors created a new way to break down and check characters piece by piece using a detailed description system called IDS, which helps the AI get more precise feedback. This better feedback makes the AI create characters that not only look right but have the right internal structure.
Open → 2609.37569v1

Semantic typography balances word clarity and image recognition

MSTypography: Multi-character Semantic Typography via Balancing Word Legibility and Object Recognizability

Abstract: Semantic typography is a design technique where the visual representation of a word conveys its semantic meaning, while maintaining its legibility. Existing digital typography methods mainly focus on single-character scenarios. They suffer from a lack of legibility constraints and insufficient local deformation when extended to multi-character words, as the intricate structures among multiple characters are hardly preserved during the typography process. In this paper, we propose a global-to-local typography framework for multi-character scenarios. It performs mask-driven silhouette approximation at the global level, while semantic-guided refinement at the local level, with a culling step in between to improve efficiency. To preserve word legibility, we designed structural losses (including explicit collision constraints and implicit Jacobian singular value constraints) and an OCR constraint for character-level readability. To enhance the object recognizability, we leverage semantic guidance with diffusion priors, which drives the character glyph toward the target concept while preserving its structural integrity. To the best of our knowledge, this is the first multi-character semantic typography method that effectively balances word legibility and object recognizability. Evaluations on five representative languages (English, Chinese, Japanese, Korean, Arabic) demonstrate superiority over SOTA methods. Codes will be open-sourced.

Tue 29 SeptComputer Vision and Pattern RecognitionGraphics
The gist
Making words look like pictures can be tricky because the letters still need to be readable. The authors built a method that changes entire words instead of just single letters, keeping the words clear while making them resemble the desired shapes. They use a two-step process: first matching the overall shape, then refining individual letters, while checking that the text remains readable by OCR. Their approach works across several languages and improves over previous methods.
Open → 2609.37141v1

System recovers editable graphics code from diagram images

Back2Struct: Making Structured Images Editable Again

Abstract: Structured images, such as diagrams, charts, and flowcharts, are inherently symbolic and can be compactly represented in an editable format, yet in practice, they are often rendered as images, and therefore not graphically editable. This mismatch presents a significant challenge for researchers, engineers, and designers who wish to incorporate modified versions of existing graphic content into new materials without manually reconstructing it. In this study, we presentBack2Struct, which "makes structured images editable again" by directly recovering vector graphics code (SVG / XML) from image representations. Given an image of a structured graphic, Back2Struct predicts semantically object-level SVG / XML code that explicitly encodes text, shapes, topology, and layout, rather than performing low-level pixel vectorization. The generated code can be seamlessly imported into tools such as PowerPoint, allowing users to edit, refine, restyle, and reuse graphic content while preserving structural fidelity. Beyond supervised fine-tuning on ground-truth SVG token sequences, we further optimize Back2Struct with reward-based learning to better match deployment-time requirements: the output should be syntactically valid, properly concise, and visually faithful to the input diagram. Specifically, we design a composite reward that jointly encourages SVG / XML compilability, length consistency with the reference code, and structural or semantic similarity between the generated and ground-truth graphics. These complementary signals guide the model to produce SVGs that are not only closer to the training distribution, but also more complete, editable, and renderable in practice. Experiments show that Back2Struct improves accuracy, editability, validity, and user alignment over baselines. Dataset and code are available at: pengyu965.github.io/Back2Struct.github.io

Tue 29 SeptComputer Vision and Pattern Recognition
The gist
Images of diagrams and charts are often saved as pictures that cannot be easily changed without redrawing them. The authors introduce Back2Struct, a tool that turns these pictures back into editable graphic code. Instead of just tracing lines, it understands the parts like text and shapes, so the output can be edited in common software like PowerPoint. They also trained the system to make sure the output code is correct, clear, and looks like the original image.
Open → 2609.37016v1

Motion grounded drag editing improves precision and realism in image manipulation

Drag as Evidence: Motion-Grounded Latent Recomposition for Drag-Based Editing

Abstract: Modern image editors excel at semantic manipulation and visual synthesis, yet remain limited in precise spatial control, motivating the development of drag-based editing. However, existing drag-based methods often struggle to balance drag accuracy with natural, plausible, and intent-aligned generation. We propose MoRe-Drag, a motion-grounded drag-based editing method. Our key insight is to treat pixel-space warping as coarse motion evidence, and to inject this evidence into the generative sampling trajectory. Specifically, MoRe-Drag performs region-aware latent recomposition over refinement, inpainting, and anchor regions, coupled with stage-adaptive conditioning that progressively shifts from motion-grounded structure formation to semantic refinement. We further support an instruction-free interface by adapting the MLLM-based text encoder for drag-aware instruction inference. Experiments on DragBench-SR and DragBench-DR show that MoRe-Drag substantially improves drag precision over strong base editors and achieves superior drag accuracy among SOTA drag-based methods, while delivering strong semantic consistency and visually realistic results. Code and dataset will be publicly released.

Tue 29 SeptComputer Vision and Pattern Recognition
The gist
Editing images by dragging parts of them is simple but often struggles to be accurate while looking natural. The authors propose a new method called MoRe-Drag that uses the dragged motion as a guide inside a smart image generation process. This method gradually builds the changed image by mixing areas that need fixing or keeping and refines it step-by-step. The authors show MoRe-Drag works better than existing methods in precision and visual consistency, and it can even interpret drag gestures without extra instructions.
Open → 2609.36755v1

Previewdiff improves image and video generation by guiding diffusion early

PreviewDiff: Multimodal Critic-Guided Search over Diffusion Latents

Abstract: Diffusion models can produce striking images and videos, but they still struggle with the compositional details that make a generation faithful to a prompt, such as object counts, attribute binding, spatial relations, and temporally grounded actions. A common way to improve prompt satisfaction is to spend more compute at test time through Best-of-N sampling, but final-sample selection is fixed. Best-of-N can only choose among completed outputs and cannot repair a promising trajectory before it fails. We introduce PreviewDiff, a training-free test-time search method that turns diffusion sampling from scalar search into a multimodal critic-guided search over intermediate latents. At selected denoising checkpoints, PreviewDiff decodes a partial preview, asks a multimodal judge to score and critique it, and uses the resulting natural-language feedback to branch over semantic prompt edits and locally re-noised latent continuations. These branches are then scored and selectively rolled forward, allowing verifier compute to guide generation while the sample is still editable. Across image and video generation benchmarks, PreviewDiff consistently improves over budget-matched Best-of-N selection and strong scalar-search baselines. Ablations show that earlier interventions and increased search width provide the largest gains, while deeper search and additional semantic variants offer complementary improvements. PreviewDiff demonstrates that multimodal feedback is most useful not only as a final verifier, but as an active controller inside the denoising process.

Mon 28 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceMachine Learning
The gist
Diffusion models create impressive images and videos but often mess up details like the number of objects or their positions. The authors introduce PreviewDiff, a method that checks the image as it’s being made and gets feedback using natural language to fix mistakes early. This way, it tries different ways to improve the picture before it’s finished. Their method works better than just picking the best final image from many tries and helps make images more faithful to the original instructions.
Open → 2609.36199v1

Pixel-space diffusion models improve image generation with feature specialization

Persistence Forcing: Exploiting Feature Specialization in Pixel-Space Diffusion

Abstract: Pixel-space diffusion Transformers (DiTs) directly operate on high-dimensional visual data, yet their hidden representations typically undergo uniform refinement across depth. Natural images, however, are inherently organized at different levels of granularity. Global structure can often be represented compactly, whereas local textures and fine details require richer representations. Motivated by this, we introduce heterogeneous refinement in pixel-space DiTs, assigning different feature groups distinct refinement budgets across depth. Consequently, an ordered feature specialization emerges: sparsely refined features predominantly encode global visual structure, whereas more frequently refined features increasingly specialize toward localized, high-frequency details. We refer to these two groups as persistent and active features, respectively. Building on this emergent specialization, we introduce Persistence Forcing (PerF), which explicitly exploits this persistent--active feature organization for pixel-space image generation. This enables persistent features to continuously condition actively refined features, allowing stable global information to guide the ongoing refinement of finer visual details. During generative sampling, this interaction further induces a meaningful guidance direction that promotes coherent global structure and naturally complements classifier-free guidance. On ImageNet $256\times256$, PerF-L achieves FID of $1.91$, approaching $1.86$ of JiT-H with only half the parameters, while PerF-H further achieves FID of $1.63$ and $1.76$ on ImageNet $256\times256$ and $512\times512$, respectively.

Mon 28 SeptComputer Vision and Pattern Recognition
The gist
Generating clear images from complex data is tricky because images have broad shapes and tiny details. The paper shows a way to treat different parts of an image differently during the creation process. Some features focus on the big picture while others gradually add fine details. This method helps the model make better, more coherent images by letting stable global features guide detailed features as the image forms.
Open → 2609.36014v1

Unified models learn to improve image edits by self-feedback loops

Learning Native Reflection in Unified Models with Interleaved Reinforcement Learning

Abstract: Unified multimodal models can both look at and render images, so in principle they can repair their own generations: diagnose what an image gets wrong, revise it, observe the result, and diagnose again. Whether a revision helps is known only after it is rendered, so the reflection text and the image generation must be learned jointly, over the whole loop. Supervised fine-tuning (SFT) on reflection trajectories gives a cold start but does not find the high-success repair paths, and naive RL that optimizes only the renderer or only one head leaves most of the gain untapped. We introduce UMM-Reflection, which applies reinforcement learning (RL) to complete reflection trajectories inside one unified model: sibling trajectories share one initial image, so the group-relative advantage compares reflection strategies, and one trajectory-level advantage updates both the reflection tokens and the flow-based revisions, avoiding the combinatorial blow-up of per-round credit assignment. Unlike single-round editing or pipelines with an external critic, credit flows across rounds and to both roles of the same model, and no verifier is needed at inference. On BAGEL, UMM-Reflection improves GenEval by 12.05 points over SFT, and the gains transfer to WISE (+10.97), OneIG-Bench (+3.48), and T2I-CompBench++ (+4.63), none of which is used in training.

Mon 28 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Creating better images with AI is hard because fixing mistakes often requires trying and checking results repeatedly. The authors show how to train one AI model to not only make images but also to look at its own outputs and decide how to fix them using a special type of learning called reinforcement learning. Their method lets the model learn from multiple correction steps together, making it better at improving images over time without needing extra checking tools. This approach led to better image editing performance on several tests, including ones the model never saw before.
Open → 2609.35767v1

AutoRef improves multi-image generation by optimizing harness code

AutoRef: Harness Optimization for Agentic Multi-Reference Image Generation

Abstract: Recent image generation models can take multiple reference images as input and combine them into a new image. However, multi-reference image generation remains challenging: models may omit or duplicate subjects from the references, or produce images in which multiple subjects appear unnaturally pasted. Recent work has proposed image generation agents that combine image generation models, reasoning models, and a harness, which is an executable program that specifies how reference images are interpreted, how generation is performed, how outputs are diagnosed, and how the final image is selected. In multi-reference generation, however, references play different roles and outputs must satisfy many criteria at once, such as fidelity to each reference and the naturalness of the whole image, so many parts of the harness could be improved, from how references are processed to how outputs are diagnosed. This makes it hard to predict which changes will improve performance and by how much, and good harnesses difficult to design by hand; indeed, human-written harnesses vary widely in performance. We therefore propose AutoRef, which optimizes the harness automatically while keeping both models frozen: a coding agent iteratively rewrites the harness code. AutoRef separates the tasks whose feedback informs proposals from the tasks used to select candidates, and continues the search from a beam of the top-ranked harnesses on the selection tasks. Using this procedure, we discover AutoRef-Harness, which improves the open-weight FLUX.2 [klein] 4B from 5.72 to 7.37 on held-out four-reference tasks of the MultiBanana benchmark, matching or exceeding proprietary models including Nano Banana Pro and GPT-Image-1.5. Without re-optimization, the same harness also improves results when the generator, number of references, benchmark, evaluator, or reasoning model differs from those used in the search.

Mon 28 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Creating new images from multiple input pictures is tricky because models can miss or repeat parts or make images look unnatural. The authors show that programs called harnesses guide how input images are used, but writing these manually is hard and often inconsistent. They introduce AutoRef, which automatically rewrites the harness to improve image quality without changing the underlying models. This approach boosted performance on a benchmark test, matching or beating even some proprietary systems. The improved harness also worked well in different settings without needing more tuning.
Open → 2609.35530v1

Few-step generative models aligned using direct preference optimization

FestDPO: Few-step Generator Alignment with Direct Preference Optimization

Abstract: Few-step generative models can generate high-fidelity samples within a few function evaluations. Despite this efficiency, generated samples may not exhibit desirable properties. When these properties are difficult to encode as an explicit reward function, direct preference optimization (DPO) can align generative models using pairwise preference feedback without training a separate reward model. However, extending DPO to few-step generative models is challenging because few-step generative models are generally implicit, making the likelihood evaluation required by DPO intractable. To address this challenge, we introduce Few-step DPO (FestDPO), an extension of DPO for few-step generative models that leverages nonparametric likelihood estimation from empirical samples. By exploiting the fast sampling capabilities of few-step generative models, our approach makes sample-based approximation of DPO loss computationally feasible. Furthermore, the sample-based formulation makes FestDPO agnostic to the model family and sampling procedure. Our toy experiment demonstrates that FestDPO matches the reward-tilted target distribution across four few-step generators. For real-world tasks, we evaluate FestDPO in two domains: text-to-image generation and protein backbone generation. In text-to-image generation, FestDPO outperforms preference optimization baselines in both win rates against the base models and human evaluation scores. In protein backbone generation, it achieves a higher $β$-sheet fraction and better structural designability than the baselines.

Mon 28 SeptMachine Learning
The gist
Some computer programs can quickly create things like images or protein shapes, but these creations might not always meet what we want. The authors worked on a way to improve these programs by teaching them with human preferences directly, without needing to guess scores in between. They developed a new method called FestDPO that can handle these quick programs even though they don’t easily show how likely their outputs are. Tests showed FestDPO can better align creations with human preferences in pictures and proteins.
Open → 2609.34673v1

DecFlowEdit improves image edits by better separating changes from background

DecFlowEdit: Self-Localized Flow-based Image Editing via Guidance Decoupling

Abstract: Flow-based image editing (FlowEdit) enables inversion-free semantic changes through the difference between source and target velocities. In this paper, we observe that FlowEdit's default classifier-free guidance (CFG) configuration, with asymmetric source and target scales, causes substantial background leakage. Matching these guidance scales, for example by removing CFG, improves edit-relevant localization but severely degrades editability. To get the best of both worlds, we propose DecFlowEdit, which decouples the optimal guidance scales for localization and for editing in flow-based generative models. In particular, DecFlowEdit first extracts an edit-relevant prior by temporally aggregating velocity differences evaluated without CFG, and then uses this prior to reweight the original updates under default CFG. Our method remains training-free and inversion-free, requiring neither external spatial masks nor attention manipulation. Experiments on PIE-Bench across FLUX, SD3, and SD3.5 show that DecFlowEdit improves background preservation, reducing structure distance by approximately 61 to 73 percent and background LPIPS by 68 to 80 percent relative to FlowEdit at comparable editing fidelity.

Mon 28 SeptComputer Vision and Pattern Recognition
The gist
Editing images without messing up the background can be hard because changes sometimes spill over where they shouldn’t. The authors found that the usual way these edits guide the changes causes unwanted background effects. They developed DecFlowEdit, a technique that separates how it figures out where to edit from how it applies the edits. This approach keeps the background intact while still making good changes, and it works without extra training or complicated tools. Tests showed it preserves backgrounds much better than previous methods while keeping edits accurate.
Open → 2609.34237v1

ReVision tool helps designers mix concepts and visuals creatively

ReVision: Supporting Designers' Interpretation and Exploration of Visuals in Concepts and Forms

Abstract: Visual designers get inspiration from references to expand their design space. They decompose what makes a reference evocative into conceptual and visual elements, ranging from explicit attributes such as objects and colors, to less readily articulated concepts and visual motifs. They then create different visual forms to explore how the selected elements could be combined differently. Novices often struggle with these moves, instead focusing on surface features or producing limited visual variation, thus becoming fixated on the reference. Existing tools support editable visual attributes and high-level themes, but provide limited control over how conceptual interpretations relate to expressive visual motifs or how their combinations can be systematically re-expressed. We present ReVision, an AI-based tool that decomposes visual and textual references into editable conceptual interpretations and visual motifs, enables their recombination across conceptual and visual spaces, and renders each direction as divergent visual-form variations, supporting more divergent exploration during the creation process.

Sun 27 SeptHuman-Computer Interaction
The gist
Designers often look at existing images or ideas to get inspiration but can get stuck copying them too closely. The authors created ReVision, a tool that breaks down images and descriptions into pieces like concepts and visual patterns. Designers can then recombine these pieces in new ways to make different versions instead of just copying. This helps both novices and experts explore more creative options while designing.
Open → 2609.33911v1

Multimodal models struggle to edit infographics with proper layout reasoning

InfoEdit: Probing Global Layout Reasoning in Infographic Editing

Abstract: Multimodal foundation models edit natural photographs at production quality, yet the same models struggle with structured visual content such as infographics. Unlike photographs, infographics encode information through logical relations; editing one element often requires surrounding elements to be adapted. We refer to this global layout reasoning capability as reflow. Existing image-editing benchmarks neither provide a dedicated setting for structured visual content nor evaluate the reflow capability. We introduce InfoEdit, a novel benchmark of 1,000 infographics across eight logical-relation families, paired with 4,000 editing instructions across four editing tasks, and a reflow-aware evaluation protocol. Across eight frontier editors, only GPT-Image-2 clears 60% average success rate; most models fall below 7%, and no editor exceeds 36% on the Swap-Block task even with perfect target localization. We further show that code-level editing can match the strongest pixel-level editor, revealing complementary strengths across tasks. InfoEdit identifies reflow as a central challenge in structured visual content editing and provides a diagnostic benchmark to facilitate future progress.

Sun 27 SeptComputer Vision and Pattern RecognitionComputation and LanguageSoftware Engineering
The gist
Editing photos with AI is getting good, but editing infographics is much harder because changing one part often means many others need adjustment too. The authors call this tricky problem "reflow." They created InfoEdit, a dataset and test system with 1,000 infographics and 4,000 editing tasks designed to see how well AI models manage these layout changes. Most current models perform poorly, showing this is a big challenge. They also found that editing with the underlying code can sometimes be as good as editing pixels directly.
Open → 2609.33286v1

Text to image models wrongly show figurative vehicles as objects

Presence Is Not Faithfulness: Figurative Vehicle Intrusion in Text-to-Image Generation

Abstract: Text-to-image (TTI) models increasingly generate high-quality images from natural-language prompts, yet figurative language exposes a failure: a vehicle that should guide the depiction of a tenor may instead be rendered as a visible object. We call this failure Figurative Vehicle Intrusion: the intruding content is textually licensed, but it is assigned the wrong visual role, showing that visual presence is not always faithfulness and that presence-oriented evaluation can miss such errors. To study it systematically, we introduce Vehicle Intrusion and Semantic Tenor Assessment (VISTA), a multilingual benchmark of figurative prompts organized by Figurative Form and Mapping Mechanism. We further propose V-Score, a diagnostic question-answering metric that evaluates role-aware figurative faithfulness in generated images. Evaluations on recent high-performing TTI models show that vehicle intrusion persists across languages and figurative categories. As a lightweight mitigation, we introduce VISTA-Guard, which partially reduces vehicle intrusion and suggests a practical path toward more figuratively faithful TTI generation. All resources will be released publicly.

Sat 26 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Text-to-image models try to turn words into pictures, but they sometimes get confused with figurative language. For example, if a phrase uses a vehicle as a metaphor, the model might draw that vehicle literally instead of capturing the intended meaning. The authors call this problem Figurative Vehicle Intrusion. They created a benchmark called VISTA to measure this issue and introduced a score called V-Score to evaluate how well models handle it. They also proposed a method called VISTA-Guard that helps reduce this problem in generated images.
Open → 2609.32188v1

Text to image generation boosts focus on specific objects effectively

Amplify What You Gaze At: Target Saliency Boosting in Text-to-Image Generation

Abstract: Text-to-image generation has advanced in controlling what, where, and how objects appear, yet how visual attention is distributed among objects remains largely unexplored. In this paper, we introduce Target Saliency Boosting, a new task aimed at boosting the visual saliency of a specific object during text-to-image generation without requiring any visual priors. Our key insight is that visual saliency is inherently relative: boosting the saliency of a target object also depends on the global saliency distribution across all objects in the scene. Based on this insight, we propose GazeME, a lightweight framework that uses saliency-marked prompts, inserting learnable marker tokens around object descriptions to indicate which objects to visually emphasize or suppress. To learn these markers, we construct a saliency-semantics dataset that associates objects in image--prompt pairs with object-level saliency scores, and propose Saliency Prior Marker Activation (SPMA), a saliency-aware stochastic marker activation strategy that exploits relative saliency relationships for robust training. During inference, GazeME automatically inserts appropriate markers into the prompt, thereby directly enhancing the visual saliency of the target object. Extensive experiments demonstrate that GazeME effectively boosts target saliency while preserving both semantic alignment and image quality.

Fri 25 SeptComputer Vision and Pattern Recognition
The gist
Text-to-image systems create pictures from written descriptions but often struggle to make specific objects stand out visually. The paper presents a new approach where the system learns to highlight a chosen object more clearly, without needing example images. The key idea is that making one object more noticeable depends on how other objects share attention. The authors built a method called GazeME that adds special markers in the text prompts to tell the system which objects to emphasize or downplay, improving how well the target object is seen without hurting picture quality.
Open → 2609.30733v1

Vector graphics help vision language models think with images better

Multimodal Thinking with Renderable Programs

Abstract: Current vision-language models (VLMs) excel at visual content understanding and text-based reasoning, yet their structure limits the advancement of incorporating images into the reasoning chain. Though Omnimodal models have made efforts in unifying text and image generation, they focus on visual tasks in the open-domain, lacking tractability due to rasterized or latent representations of images. We introduce SVGLM, a framework that uses scalable vector graphics (SVG) primitives to connect text and image in reasoning tasks. We exploit the duality of SVG as both image description and text instructions, yielding a more compact, interpretable solution to equip general VLMs with the capability of generating images within the reasoning process. We provide a large curated dataset of SVG-based image editing dataset, as well as the paradigm to tune open-source VLMs. Experiments on a mathematical reasoning benchmark demonstrate that SVGLM achieves strong SVG generation power as well as think-with-image intelligence. Our results highlight SVG as a suitable medium for building more robust digital domain agents, bridging the gap between text-based thinking and pixel-based images.

Thu 24 SeptComputer Vision and Pattern RecognitionComputation and Language
The gist
Vision-language models can understand pictures and text but struggle to use images when solving problems step-by-step. The authors created a new system called SVGLM that uses vector graphics (SVG) to represent images as simple shapes and instructions. This approach helps the model generate and edit images while reasoning, making the whole process easier to understand and more efficient. They tested SVGLM on math problems and showed it can think with images and create graphics better than before.
Open → 2609.30130v1

Simple symmetric Venn diagrams found with 17 and 19 curves

Simple symmetric Venn diagrams with 17 and 19 curves

Abstract: We exhibit simple, rotationally symmetric Venn diagrams with 17 curves and with 19 curves: n Jordan curves carried to one another by rotation through 2π/n, with every one of the 2^n regions present and connected and, since the diagrams are simple, every crossing on exactly two curves. Symmetric Venn diagrams exist for every prime number of curves (Griggs, Killian and Savage, 2004), but those diagrams have many curves through a point; simple ones were known only up to 13 curves (Mamakani and Ruskey, 2014). Four 17-curve and nine 19-curve diagrams were found by a Metropolis walk on rotation-invariant quadrangulations of the sphere in which regions may temporarily be duplicated, started from the Griggs-Killian-Savage diagram with its multiple crossings resolved. Every diagram is given by a machine-checkable certificate; one certificate of each size has been verified by a formal proof in Lean 4. All of the diagrams are non-monotone, which is why the crossing-sequence searches that found the 11- and 13-curve diagrams could not have found them.

Tue 22 SeptComputational GeometryDiscrete Mathematics
The gist
Drawing Venn diagrams with many overlapping circles is tricky, especially when every shape is connected and the drawing looks the same after spinning it around. The authors found new ways to create such perfectly balanced Venn diagrams with 17 and 19 circles, something that wasn’t done before for simple diagrams. They used a special search method starting from older complex diagrams and verified their results using computer proofs. These new diagrams don’t follow the usual layering rules, making them unique compared to smaller examples.
Open → 2609.26546v1

Diffusion model morphing aligns images without tuning or ghosting

AlignMorph: Tuning-Free Diffusion Image Morphing via Explicit Semantic Transport

Abstract: Image morphing aims to produce a smooth and semantically consistent transition between two input images. Existing diffusion-based morphing methods either require expensive per-pair optimization or rely on implicit spatial alignment, which easily fails under large layout discrepancies. To address these limitations, we propose AlignMorph, a novel tuning-free diffusion framework guided by the principle of transport-then-denoise. We explicitly decouple geometric alignment from generative denoising to avoid structural entanglement. Our framework consists of two core components. (1) Global Semantic Transport, which achieves diffusion-compatible semantic alignment via entropic optimal transport and reliability-aware latent warping; and (2) Coordinate-Aligned Generation, which uses a symmetric bi-phase attention handoff to maintain consistent spatial coordinates throughout denoising. Without any tuning, AlignMorph effectively eliminates ghosting and achieves superior structural coherence and temporal smoothness on morphing benchmarks. Code is available at https://github.com/51xOne/Alignmorph.

Mon 21 SeptComputer Vision and Pattern Recognition
The gist
Image morphing smoothly transforms one picture into another, but existing methods struggle when the images differ a lot in layout or require long setup times. The authors propose AlignMorph, which separates the task of matching parts of the images from creating the smooth transition, making the process easier and faster. AlignMorph uses a special way to align image content and then ensures the transformation stays consistent and clear without blurring or odd artifacts. This approach works well on tests without needing extra adjustments.
Open → 2609.24330v1

Text to image generation lets users control fine grained emotions

Beyond Emotion Prompts: Fine-Grained Text-to-Image Generation Driven by Valence-Arousal-Dominance

Abstract: Although text-to-image models can accurately depict subjects and scenes, creators still struggle to specify the fine-grained emotions an image should convey without rewriting its content description. Natural language can suggest emotions, but it offers no control scale with stable meanings and ordered intensities. We propose EMOTRANS, which transforms psychologically grounded valence-arousal-dominance (VAD) coordinates into generation conditions that are independent of the content text and modulated across denoising stages, making emotional style a finely adjustable creative variable. To support this goal, we construct EMOVAD, an art-painting dataset that pairs objective content descriptions with separately collected emotional ratings from multiple annotators. We also coordinate emotional expression and content preservation through dual-branch training with a shared model. Objective and human evaluations show that the framework improves the accuracy of three-dimensional emotion control and produces perceptible, orderable continuous changes while maintaining competitive text alignment and image quality. This work provides a practical emotion-driven approach to image generation that extends objective content depiction to fine-grained emotional adjustment.

Mon 21 SeptComputer Vision and Pattern Recognition
The gist
Text-to-image tools usually let you describe what you want to see but not the exact feelings an image should show. The authors created a method called EMOTRANS that uses a psychological model of emotions (valence, arousal, dominance) to guide image generation separately from the description. They made a new dataset and trained a model to change emotional style in pictures smoothly, without messing up the content or quality. Their system helps creators adjust the emotional tone of images with more precision and clearer intensity levels.
Open → 2609.24215v1

PixelART transforms images into editable layers without heavy pretrained models

PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining

Abstract: Image-to-layer decomposition converts a flattened image into editable RGBA layers, enabling element-level editing in design workflows. Existing diffusion-based systems typically adapt large pretrained text-to-image (T2I) models and introduce RGBA autoencoders or variable-layer architectural modules. We revisit this design choice and ask whether layer decomposition truly requires these heavyweight components. We introduce PixelART, a pixel-space rectified-flow Transformer trained from scratch for image-to-layer (I2L) decomposition. PixelART directly denoises regional RGBA pixel patches using a single-stream multi-modal diffusion Transformer, avoiding RGBA-VAEs, pretrained T2I backbones, and layer-specific decoders. We identify a key property of the task: high-noise timesteps determine layer assignment and coarse layer organization, while low-noise timesteps mainly refine color, alpha, texture, and boundaries. Based on this observation, we propose a terminal-boosted timestep sampling strategy to increase training coverage in the high-noise layer assignment regime. Trained on 4M multi-layer design templates, PixelART achieves state-of-the-art layer decomposition and composite reconstruction on Design-Multi-Layer-Bench and LICA with over 80% fewer parameters, 98% lower latency, and 85% lower memory than the recent Qwen-Image-Layered model. Ablation experiments show that pixel-space $\mathbf{x}$-prediction, terminal-boosted timestep sampling, and data/model scaling are critical, while T2I pretraining brings marginal benefits to the I2L task.

Sat 19 SeptComputer Vision and Pattern Recognition
The gist
Editing specific parts of an image is easier if the image is split into layers with transparency. Existing tools to do this rely on large pretrained models or complex components, which can be slow and resource-heavy. The authors introduce PixelART, a new method that learns from scratch to break down images into layers using a simpler approach. It works faster and uses less memory while still accurately separating image layers. This method avoids relying on big image-generation models and focuses on improving how layers are assigned during training.
Open → 2609.22789v1

SafeStyle improves style transfer while avoiding content leaks

SafeStyle: Calibrated Style Residual Injection for Controllable Style-Leakage Trade-off in Diffusion Stylization

Abstract: Reference-guided diffusion stylization aims to transfer visual style from a reference image while preserving the semantics specified by a text prompt. However, image conditioning often entangles transferable style cues with reference-specific content, leading to an inherent trade-off: stronger conditioning improves style fidelity but increases content leakage, whereas aggressive suppression reduces leakage at the cost of style expression. This challenge is further complicated by the distinct spatial organization of texture- and geometry-dominant styles. To address these issues, we propose SafeStyle, a training-free framework for calibrated style residual injection in frozen diffusion models. SafeStyle first estimates style-supported and content-associated subspaces from compact calibration sets, preserving their informative overlap while suppressing useless content variations. It then transports the purified style evidence over adaptive spatial granularity and constrains its effective influence through an explicit residual-norm budget. Experiments across texture- and geometry-dominant styles show that SafeStyle achieves a DINO style similarity of 0.432 while maintaining competitive text alignment. On a semantically disjoint leakage-stress benchmark, it further achieves a DINO style similarity of 0.474 with only 0.8\% semantic leakage, demonstrating an effective balance between style fidelity and reference-content suppression.

Fri 18 SeptComputer Vision and Pattern Recognition
The gist
When changing a picture’s style using another image and text instructions, it’s hard to keep the new style without accidentally copying parts of the original picture. The authors developed SafeStyle, a method that carefully adds style details without letting unwanted original content leak through. It works without extra training, by separating and controlling style and content information to find a better balance. Tests show that SafeStyle keeps style strong while reducing accidental content copying.
Open → 2609.21242v1

Paint-Anything enables precise color control for image generation and editing

Paint-Anything: Unified Any-Color Control for Image Generation and Editing

Abstract: Professional design requires any-color control: the ability to specify an object's target color with any 24-bit hex value for image generation and editing. Prior work has explored color generation, editing, and colorization, but often relies on dedicated color representations or specialized inference procedures. Advances in large language models offer a simpler starting point: even compact models can associate hex values with color semantics. We present Paint-Anything, which learns a shared hex-prompt interface for generation and editing through object-level color supervision. We develop a data pipeline that constructs Paint-500K from real images through object grounding, perceptual color labeling, and editing-pair synthesis. Since shadows make real-image labels only approximate colors, we complement this supervision with pure-color anchors whose pixels exactly match their paired hex values. These anchors are used only at high-noise timesteps, leaving low-noise training to natural images. We further introduce Any Color Benchmark (ACBench), comprising ACBench-T2I and ACBench-Edit, to measure object-level hex color fidelity across both tasks. On FLUX.2-4B, Paint-Anything improves ACBench-T2I and ACBench-Edit scores by 85.3% and 28.3%, respectively, relative to the base model, with ablations supporting the training recipe. It also achieves the highest average CompColor score among the compared methods.

Thu 17 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceMachine Learning
The gist
Changing the exact color of objects in computer-generated images is hard, especially when you want to pick any color from the full digital palette. The authors created Paint-Anything, a system that learns to associate specific color codes (hex values) with objects in images to generate or edit images with precise color control. They built a large dataset from real pictures mixed with exact color samples to train their model and developed tests to measure how well it matches targeted colors. This approach improves color accuracy in both creating new images and editing existing ones.
Open → 2609.20816v1

RefineEdit lets users fix parts of AI image edits without retraining

Refinement Is Inherently Editable: Training-Free Prompt-to-Prompt Image Editing with Generative Refinement Network

Abstract: Text-guided image editing must introduce the requested changes while preserving unrelated source content. Diffusion-based editors rely on spatial controls whose inaccuracies can leave edits incomplete or alter unrelated regions. Causal autoregressive editors face a further constraint: their fixed decoding order limits revision of earlier decisions. We introduce RefineEdit, a training-free prompt-to-prompt image editing framework built on a Generative Refinement Network. Our key idea is to couple edit localization with content generation through the global refinement of binary image codes, allowing editing evidence to be reassessed as the image evolves. RefineEdit initializes an editing branch from an intermediate source state, reusing the emerging layout. We compare the probabilities assigned by the two branches to the same source-sampled bits, using their signed differences to select editable positions and bits. Selected bits follow editing refinement, while the remaining bits copy the evolving source state. To stabilize editing across refinement steps, adaptive spatial freezing limits unnecessary mask expansion, while finite bit locking keeps recently selected bits editable. The framework requires no additional training, external masks, or attention control. Across nine editing categories of PIE-Bench, RefineEdit achieves the best background-preservation scores in PSNR, LPIPS, MSE and SSIM, together with the highest whole-image and edited-region CLIP scores among the evaluated methods.

Thu 17 SeptComputer Vision and Pattern Recognition
The gist
Editing AI-generated images can be tricky because some methods can only change parts of the image in a fixed order or need extra tools like masks. The authors present RefineEdit, a new way to edit images generated by AI that doesn’t need extra training or complicated controls. It works by carefully deciding which parts of the image code to change while keeping other parts the same, allowing easy revisions even after some changes have been made. This method preserves the parts of the image you don’t want to change better than current approaches.
Open → 2609.20633v1

Feature rearrangement improves single image generation quality and structure

FRPSS: Feature Rearrangement in Pre-Shape Space for Single-Image Generation

Abstract: Generative models trained on a single image often struggle to balance global structural integrity and local diversity. Existing single-image generation methods commonly rely on random noise to drive the generation process and lack explicit global structural constraints, making the generated results prone to spatial structural misalignment when structural variations occur. To address the issue, Feature Rearrangement in Pre-Shape Space for Single-Image Generation (FRPSS) is proposed in this paper. The core of FRPSS is the Manifold Structural Rearrangement with Feature Augmentation on Geodesic Surface (MSR-FAGS) module. MSR-FAGS replaces the randomly initialized features of the low-scale generator with rearranged Pre-Shape features and uses the features to guide image generation at subsequent scales, thereby reducing the risk of structural misalignment. To support downstream tasks such as stylization, a Scale-adaptive Sliding-window Patch Extraction (SSPE) strategy is further designed, and a directional Contrastive Language-Image Pre-training supervision module with SSPE (CLIP-SSPE) is constructed. Qualitative and quantitative experiments demonstrate that FRPSS achieves the best Single Image Fréchet Inception Distance (SIFID) scores on all three datasets while maintaining competitive Learned Perceptual Image Patch Similarity (LPIPS). Further qualitative experiments verify the effectiveness of FRPSS across multiple downstream tasks with the CLIP-SSPE module.

Tue 15 SeptComputer Vision and Pattern Recognition
The gist
Generating new images from just one original picture is tricky because the new images can lose important shapes or look too similar. The paper presents a new method that rearranges features from the original image in a special way to keep the overall structure intact while allowing variety in details. This method reduces mix-ups in the image layout during generation. The authors also created tools to help stylize images based on this approach, showing better performance than previous methods.
Open → 2609.16594v1

Vision language model improves editable svg creation with semantic structure

Compositional SVG Generation via VLM-Driven Hierarchical Semantic Parsing

Abstract: While Vision-Language Models (VLMs) excel at visual reasoning, generating structured, editable Scalable Vector Graphics (SVG) remains a fundamental challenge. Existing pipelines predominantly yield flat, semantically agnostic collections of paths, where editing a single object requires manually identifying its constituent paths. To address this, we propose a VLM-driven agentic framework for semantic compositional SVG generation. Our pipeline recursively parses visual scenes into semantic and geometric hierarchies via top-down decomposition, visual grounding, and prompt-driven amodal occlusion recovery, ensuring each component is geometrically complete. Furthermore, we introduce the Semantic SVG Benchmark with human-annotated semantic groups and novel sub-component metrics (Semantic Recall/Precision, PERE) to explicitly evaluate structural compositionality and functional editability. Experiments show that our natively predicted structures surpass the upper bounds of existing flat-generation methods in both grouping quality and editability, while maintaining state-of-the-art visual fidelity.

Sun 13 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Creating editable vector graphics can be tricky because current methods produce disconnected shapes that are hard to modify individually. The authors propose a new approach where a vision-language model breaks down images into meaningful parts arranged in a hierarchy, making each part complete and easy to edit. They also introduce a new benchmark to measure how well these parts match human understanding and how easy they are to work with. Their method produces more accurate and user-friendly vector graphics than earlier techniques.
Open → 2609.14657v1

Image generation balances emotion and content through new reinforcement method

Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring

Abstract: Continuous emotion control in text-to-image generation requires a model to improve affective alignment without changing the objects, layout, or scene described by the prompt. Existing supervised emotion-injection methods often optimize feature-space proxies and may therefore exhibit emotion-semantic drift, in which stronger emotional conditioning is accompanied by unintended content changes. We address this problem with a flow-matching image-generation framework that combines continuous valence-arousal (VA) conditioning, Group Relative Policy Optimization (GRPO), and a neutral semantic anchor. The deterministic probability-flow ODE is converted into a marginal-preserving SDE, yielding non-degenerate transition densities for trajectory sampling and policy-ratio estimation. A frozen CLIP-based VA regressor supplies a terminal reward measuring the distance between the predicted and target VA coordinates, while an image generated from the same prompt under zero VA conditioning provides a feature-space reference for semantic preservation. A reduced denoising schedule is used for online RL sampling, whereas the original schedule is retained at inference. Experiments on 3,300 prompt-emotion combinations show substantially lower valence and arousal errors than the VA-conditioned baseline and an improved CLIPScore relative to EmotiCrafter, with a measurable trade-off in reference-free image quality. The results support anchor-regularized Flow-GRPO as a practical approach to balancing emotional alignment and semantic consistency in continuous-affect image synthesis.

Fri 11 SeptComputer Vision and Pattern Recognition
The gist
Generating pictures that match both what they show and the feelings they should convey is tricky because changing the emotion can unintentionally change the content. The authors developed a new approach that uses a kind of learning called reinforcement learning combined with an emotional map based on feelings called valence and arousal. This approach helps the system create images that better match the intended emotions while keeping the scene and objects consistent. They tested it on thousands of prompts and demonstrated it improves emotional accuracy without losing important picture details.
Open → 2609.12830v1

Image editing method improves precision and keeps context intact

Semantically Aligned Gradient-Driven Context-Preserving Image Editing

Abstract: Instruction-guided image editing has a training-time blind spot. Generative editors are never required to semantically verify whether their outputs actually satisfy the instruction. Supervision stops at reconstruction and input textual-level conditioning. This produces incomplete edits, spatial spillover, and poor localization. We present IABEdit, a model-agnostic framework that embeds differentiable semantic verification into training. A frozen vision-language model extracts spatially-aware descriptors from the ground-truth edit. A trainable aligner then reproduces them from the generated output. The residual between the two becomes a gradient that teaches the generator both what to edit and where, with no inference-time VLM cost. IABEdit is compatible with diverse backbones, including U-Net (Stable Diffusion) and MMDiT (FLUX), without altering their inference pipelines. On MagicBrush, it improves structural fidelity by +3.49 DINO-I over the best diffusion baseline and +1.26 over the best overall baseline, while remaining competitive on instruction alignment. It also achieves state-of-the-art instruction adherence performance on RealEdit and EMU Edit benchmarks based on embedding-based metrics. Most consequentially, on the D-LORD surveillance benchmark, it surpasses the proprietary Gemini agent by +5.13 DINO-P under heavy occlusion, where preserving identity is hardest. This shows that gradient-aligned VLM distillation holds up under real-world-like surveillance and occlusion conditions. Human and GPT-4o evaluations confirm perceptually precise, well-localized edits.

Fri 11 SeptComputer Vision and Pattern Recognition
The gist
Editing images by following instructions can be tricky because many tools don't check if the changes truly match what was asked. The authors created a system called IABEdit that teaches image editors to understand both what changes to make and exactly where to make them. It uses a smart way to compare the edited picture with a perfect example and corrects the mistakes during training. This approach works well with different image editor designs and improves how well edits match instructions, even in tricky cases like blurry or blocked faces in surveillance footage.
Open → 2609.12691v1

Model generates images and layouts together for better design templates

Learning Interaction between Image and Layout Priors for Joint Image-Layout Generation in Design Templates

Abstract: In this paper, we address the problem of graphic design template creation, which generates a background image and a layout of foreground elements over the background to form a harmonious composition from an input text. Prior work on graphic design generation mostly adopts a sequential paradigm, where design elements are generated sequentially. We argue that such a sequential scheme falls short of faithfully capturing the dependency between the background and layout (and thus the joint image-layout distribution), which limits the quality of generated design templates. To overcome this limitation, we propose a model, InterIL, which jointly generates the two modalities, background image and layout, in a single generative process. The novel design of our joint model connects the backbones of pretrained image and layout diffusion models with a learnable communication module to explicitly model bidirectional image-layout interaction. During training, the image and layout backbones are frozen to maintain and leverage the vast pretrained single-modality prior knowledge, while only the communication module is updated, so that the model can focus on learning image-layout interaction and thereby better capture the joint image-layout distribution for improved composition harmony. Our model has no design-specific inductive bias, which allows it to better preserve the original characteristics of realistic designs. We further introduce a test-time guidance strategy to enable users to impose their specific preferences on generated results. Our experiments show that, compared with prior approaches, our model can generate significantly better results in terms of image, layout and image-layout harmonization, producing outputs closer to real samples. We also demonstrate the flexibility of our model in enforcing user preferences at inference without retraining.

Thu 10 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceGraphics
The gist
Creating graphic design templates usually means making a background image and placing items on top one after another. The authors found this sequential method misses how backgrounds and layouts affect each other. They built a new model that creates the background and layout at the same time, letting them interact during the process. This approach keeps the realistic look of designs and lets users guide the results without retraining the model.
Open → 2609.11519v1

Diffusion model edits images precisely using flexible area control

Overpainting: Localized Context-aware Diffusion Image Editing

Abstract: We present "overpainting", an image editing operation which offers both control over the location of the edit and awareness of the previous content in that location. The overpainted area is given by a trimap, where white-annotated pixels must be edited, gray-annotated pixels may be edited, and black-annotated pixels must not be edited. This enables both precise and loose control, depending on user intent. We implement overpainting by adapting a pretrained image editing diffusion model using a combination of joint attention and low-rank adaption across input images with attention-dropout to balance the information flow between noise, source and mask images. We present a novel, automated, training data generation pipeline that (1) generates a set of candidate image pairs leveraging existing language-based editing models, (2) carefully curates those pairs, and (3) extracts a trimap from each usable pair. We demonstrate the versatility of our overpainting model on a wide range of editing tasks.

Wed 9 SeptComputer Vision and Pattern Recognition
The gist
Editing images can be tricky when you want to change only a specific part without affecting the rest. This paper introduces a method called overpainting that allows users to specify exactly which areas to edit, which may be edited, and which must remain unchanged. The researchers improve a type of AI called diffusion models to do this by teaching it to focus on the right parts using a special mask called a trimap. They also created a way to automatically generate training examples so the model learns many kinds of edits. This approach works well for a variety of image editing tasks, giving users more control.
Open → 2609.10811v1

Text to image generation gain new control over styles and concepts

AcFlow: Controlling Text-to-Image Diffusion Transformers via Learned Conditional Activation Flow

Abstract: Text-to-image diffusion transformers (DiTs) are powerful generators, yet direct prompting provides limited control interface for style intensity and can fail to suppress unwanted concepts. To enable these controls, we introduce AcFlow, an inference-time controller that transports intermediate layer image-token activations through a learned concept-conditioned velocity field while keeping the base DiT frozen. A textual concept description specifies the desired intervention, while the integration horizon provides a continuous control parameter. The field produces token-varying, activation-dependent updates. With parameters shared across concepts within each task family, the field supports fine-grained descriptions and generalizes to concepts unseen during training without per-concept fitting. On style control, AcFlow achieves the best style--content trade-off among the evaluated baselines in the high-style-alignment regime. At a fixed operating point, AcFlow attains style--content alignment of 0.5365/0.2860, compared with 0.4397/0.2684 for the baseline with the highest style alignment. Qualitative results demonstrate suppression of diverse concepts, including cases where direct prompting fails. Our analyses support the learned velocity field as an adaptive control mechanism, with update directions varying across tokens and depend on their activation states. Our code is available at https://github.com/Nove1yst/AcFlow.

Wed 9 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Diffusion transformers for turning text into images are very good but hard to control in how strongly a style shows or what unwanted parts appear. The authors created AcFlow, a tool that changes intermediate image data inside the model during its run, guided by a description of what to change. AcFlow can smoothly adjust style intensity and better remove unwanted parts without retraining the model or needing new data for each style. Tests show AcFlow does better than other methods at balancing style and content, and it works even for styles it has never seen before.
Open → 2609.10723v1