Papers for

creative ai tool builders

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Text to image models tested on hardest visual challenges

GenOlympiad: Benchmarking Frontier Image Models at Their Capability Boundaries

Abstract: Text-to-image models have made tremendous progress and can produce high-quality images. However, a question which would be asked in any other discipline is where the frontier models fall short. We introduce GenOlympiad, a benchmark which provides the most challenging text prompts from nine capability axes for stress-testing frontier text-to-image models. The assessed capabilities include generating large quantities, performing deep reasoning, ensuring hard physical consistency, following complex rules and so on. The prompts are designed such that prompt alignment is visually verifiable (e.g., counting) instead of relying on subjectiveness (e.g., style). Based on this, we develop an automated evaluation framework which decomposes the prompt into easy and hard questions, and for most hard questions, draws help lines to ground evidence for accurate grading. We evaluate 20+ strong text-to-image models, including Nano Banana Pro, GPT-Image-2.5, Seedream-5.0 and so on. We report that even the best-performing T2I model (Nano Banana Pro) only achieves a strict score of 23.9 out of 100 and that coding models such as GPT-6 Astra have higher prompt alignment scores (but not as visually pleasing). We also derive insights in model evolution, alignment with Elo scores, and effectiveness of our grounding-based evaluation protocol. Code is available at https://github.com/GenOlympiad/GenOlympiad and the project page is at https://genolympiad.github.io/

Mon 19 OctComputer Vision and Pattern Recognition
The gist
Text-to-image AI models can create impressive pictures from words, but it’s unclear where they struggle most. The authors created GenOlympiad, a tough test with 9 types of difficult challenges, like counting objects or following rules exactly, to see how well these models do. They tested over 20 models and found even the best could only get about 24% perfect on hard prompts. This work helps show the limits of current image generation AI and gives tools to measure progress clearly.
Open → 2610.26850v1

Swift method improves diffusion model training without extra inference cost

SWIFT: Self-guided Weak-to-strong dIFfusion models via Target extrapolation

Abstract: Training high-quality diffusion models is computationally expensive, and inference-time guidance often adds further sampling cost. In this work, we introduce Swift, a simple yet effective self-guided training method that uses a frozen weak denoiser to improve a stronger model without adding inference overhead. For each noisy input, Swift extrapolates the clean regression target away from the weak denoiser's prediction, amplifying components that remain underfit. The weak guide can be an early training checkpoint, requires no backpropagation during main-model training, and is discarded afterward. The resulting model retains the original sampler and supports both conditional and unconditional generation without label dropout or an unconditional branch. We explain this mechanism through a spectral analysis of finite-time population gradient flow in an RKHS. With an early-stopped weak guide, we prove that a nonempty range of extrapolation strengths yields strictly lower posterior-mean error than matched standard training, despite shifting the regression target away from the posterior mean. Experiments on CIFAR-10 and ImageNet-256 demonstrate improvements across model scales and representations. In one ImageNet-256 configuration, Swift surpasses the baseline's best FID using roughly half the total training compute, including guide preparation and training overhead. On RAEv2, it achieves FID 1.15 without inference-time guidance and 0.99 with guidance. These results establish target extrapolation as an effective approach to weak-to-strong diffusion training with efficient single-model inference.

Mon 19 OctMachine LearningArtificial IntelligenceComputer Vision and Pattern Recognition
The gist
Training advanced image generation models called diffusion models can take a lot of computing power, and making them better during use can slow them down. The authors created Swift, a way to improve these models during training by using a simpler, frozen guide model to nudge the main model without slowing down later. Swift adjusts the training target to focus on the parts the simple guide misses, producing better results without extra steps when generating images. They tested this on popular image datasets and found it improves quality and efficiency.
Open → 2610.25844v1