Papers for

automated puzzle solving teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Image generation improves by learning the best fill order

PONDER: Learning to Generate in the Right Order

Abstract: We introduce PONDER, a method that learns in which order an image generator should fill in content and which of its earlier predictions to revise. Masked generative models construct a sample by repeatedly filling in subsets of missing variables. The order of these partial predictions determines the context available in subsequent steps and therefore affects the quality of the final sample. Common strategies are to choose the order randomly or based on local confidence estimates. Conditioned on the partially generated sample and the generator's features, our policy chooses which positions to fill next and/or which previously filled positions to mask for later regeneration, a mechanism we call rethinking. In this way, the generation process is able to adapt to the evolving context and also to revise earlier predictions. We optimize the policy using group-relative policy gradients, with rewards that measure constraint satisfaction, human preference, or distribution quality. For the latter, we introduce FIDgrad, an image-level reward derived from the (first-order) change in Fréchet Inception Distance caused by adding a generated sample to the current feature distribution. With the generators frozen, learned ordering reduces MAR-B ImageNet FID from 4.09 to 2.78 and raises the accuracy on hard visual Sudokus from 3.9\% to 56.6\%, surpassing uncertainty-based greedy ordering (38.7\%). Rethinking further improves these results to 2.70 FID and 96.7\% accuracy, while increasing the rethinking budget of a fixed policy yields continued improvements at inference time.

Fri 16 OctComputer Vision and Pattern Recognition
The gist
Generating images step-by-step means deciding where to draw first, next, and how to fix what was drawn before. The researchers developed PONDER, a system that learns the best order to fill in parts of an image and when to revise earlier parts to get better final results. Instead of picking which part to draw next randomly or just based on confidence, PONDER uses a policy that looks at the partially finished image and decides the next best step. Testing shows this method produces sharper images and solves difficult visual puzzles more accurately than earlier methods.
Open → 2610.23531v1