Papers for

automated reasoning teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Looped flows improve reasoning by refining computation over time

Thinking with Looped Flows

Abstract: Humans and machines often solve harder problems by spending more time on computation. In deep learning, looped models implement this idea during inference by recurrently updating a hidden state. In practice, however, their training backpropagates through only one or a few updates, making it hard to train early updates to support future ones. We propose looped flows, an approach that sidesteps this issue by training the recurrence with local denoising objectives. By imposing temporal association across denoising objectives through progressively decreasing noise levels and shared noise, the model is incentivized to learn recurrent states that transfer useful computation over time, even when gradients cover only a few updates. We then formulate inference as integrating the velocity of a probability flow parameterized by the learned denoiser, coupled with recurrent states. This allows solving harder problems by spending more computation through a finer temporal grid and enables multiple valid predictions from different initial noise samples. Across six reasoning benchmarks including two multi-solution benchmarks, looped flows outperform prior state-of-the-art looped models overall, achieving 58.8% test accuracy on ARC-AGI-1 and 12.2% on ARC-AGI-2.

Thu 10 SeptMachine LearningArtificial Intelligence
The gist
Solving hard problems often requires a computer to think for longer by repeating steps. The authors found that teaching a model to improve its own thinking step-by-step using small local challenges helps it plan better for future steps. They tested this approach on several reasoning puzzles and it did better than previous similar models. The new method also allows for making different valid guesses depending on starting conditions.
Open 2609.11801v1