Papers for

software developers in creative tools

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Diffusion models learn stepwise programs for flexible image editing

Dancing Diffusion: Learning Continuous Programs for Image Generation and Editing

Abstract: Diffusion models generate samples through a multi-step denoising trajectory, yet condition every step on the same instruction, so the trajectory cannot be addressed at the level of individual operations. We introduce Dancing Diffusion, which assigns each span of timesteps a dedicated continuous condition block and thereby turns conditioning into a latent program. A compiler maps text features into this program, and a fixed pretrained generator executes its blocks over successive sampling intervals. The trajectory can then dance, keeping its executed history while its continuation is redirected. A shared prefix is executed once and reused, and a later operation is rewritten while content fixed by earlier operations is preserved. The compiler is trained through the images it produces, with visual feedback on both the requested change and the retained content. On SANA, reusing an executed prefix preserves markedly more of the scene than regenerating from noise at a similar strength of edit, learned conditions preserve more background than native prompt switching from the same saved state, and the learned program improves generation quality over native SANA. Later branches weaken the edit, which leaves semantic control over individual operations limited. By converting a single-instruction trajectory into a program of addressable operations, Dancing Diffusion lays a foundation for structured intermediate computation in diffusion models.

Tue 20 OctArtificial IntelligenceGraphics
The gist
Diffusion models create images by gradually removing noise, but usually follow one fixed instruction throughout the process. The authors developed Dancing Diffusion, which breaks the image generation into parts, each guided by different instructions acting like steps in a program. This allows changes to be made in later steps without undoing earlier parts, making editing more precise and preserving parts of the image. Their approach improves how well changes stick and keeps more of the original scene intact compared to standard methods. This work opens the door to more structured and controllable image generation.
Open → 2610.28003v1

NarrativeSteward helps authors manage AI-generated interactive stories

NarrativeSteward: Coordinating Delegation, Guidance, and Verification in Agent-Assisted Interactive Narrative Authoring

Abstract: Autonomous AI agents can turn authors' goals into interactive narratives by independently organizing and carrying out generation and revision. As agents generate and revise extensive content, authors struggle to grasp its overall structure, local details, and relationships, complicating continued guidance. We present NarrativeSteward, an authoring environment that organizes outlines, worldbuilding, and narrative graphs as linked artifacts for agent implementation and author guidance. Agent dialogue and project-wide structural review help authors understand the evolving work and guide local and cross-layer revisions, while change records and execution verification help authors assess the resulting work. Technical tests validated the system's change records, recovery mechanisms, and execution diagnostics. In a 12-participant within-subject study, NarrativeSteward supported easier formulation of revision requests and inspection of changes, and greater perceived understanding of changes and story structure, than general-purpose agents. Qualitative findings show how reviewing the work and feedback helps authors develop requirements and guide subsequent delegation. We open-source NarrativeSteward at https://github.com/Tencent/NarrativeSteward.

Wed 30 SeptHuman-Computer InteractionArtificial IntelligenceComputation and Language
The gist
Creating interactive stories with AI agents can produce a lot of content, making it hard for authors to keep track. The authors developed NarrativeSteward, a tool that organizes story elements and helps writers understand and guide the AI's work. It lets authors review the story structure and changes, making it easier to request edits and verify results. Tests and a study showed it improved authors’ ability to manage and revise interactive narratives compared to general tools.
Open → 2609.39333v1