Papers for

media and entertainment companies

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Spectral correction improves guided image generation quality and consistency

Correcting Guided Diffusion Trajectories with Spectral Alignment

Abstract: The practical success of conditional image generation hinges on fine-grained differences in condition alignment and visual fidelity. Classifier-free guidance (CFG) is central to this success, but its lack of an explicit criterion makes it difficult to assess whether the guided trajectory is progressing as intended. To address this gap, we show that spectral alignment provides a principled criterion for understanding guidance behavior and improving guided diffusion sampling through adaptive correction. Our analysis identifies the spectra of intermediate states as an indicator of consistency with the expected spectral evolution of the forward process. Based on this observation, we introduce Spectral Correction Guidance, a method that corrects deviations from an analytic reference spectrum during sampling. The proposed method is training-free and applicable across diffusion backbones and conditional generation tasks without modifying the underlying model. Experiments demonstrate consistent gains in preference-based metrics over baseline guidance methods in text-to-image generation and improved generation quality over CFG on ImageNet. These improvements persist across a range of guidance scales and with fewer denoising steps. Our analyses and ablations provide insight into guidance behavior and how the proposed method affects generation quality.

Fri 2 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Generating images from text or other conditions often uses a technique called guided diffusion, which can be hard to know if it's working properly. The authors show that looking at the 'spectra'—patterns in the evolving image states—can reveal if the process is on track. They introduce a way to adjust the image creation steps based on these spectral checks, improving the quality without extra training or changing the base models. Their method works across different tasks and settings, making image generation more reliable and visually better.
Open → 2610.02753v1