Sol-Refiner speeds up high-resolution video refinement with one step
SoL-Refiner: Speed-of-Light One-Step Refinement for High-Resolution Video
Computer Vision and Pattern Recognition
Summary
Making high-resolution videos takes a lot of computer power. The authors found a way to first make a lower-quality video and quickly improve it to very high quality in just one step. They trained their method carefully and tested it against others, showing it is both faster and better at refining videos. This approach can make producing detailed videos more efficient and quicker.
What this means in practice
- •For video production teams: Improve the quality of low-resolution videos to 4K quickly, speeding up the video production pipeline with one-step refinement.
- •For streaming service engineers: Reduce the computational cost and delay of upscaling user-uploaded videos to high resolutions in real time.
Authors
Haozhe Liu, Tian Ye, Shuchen Xue, Yitong Li, Junsong Chen, Haopeng Li, Jincheng Yu, Duomin Wang, Ruihua Zhang, Lei Zhu, Song Han, Enze Xie
Abstract
High-resolution video generation is expensive, as its cost grows rapidly with the number of spatiotemporal tokens. A practical alternative first generates a lower-resolution video and then applies a refiner, but conventional multi-step refinement introduces a second sampling bottleneck. We present SoL-Refiner, a one-step video refiner that transforms low-resolution model outputs into 4K videos with a single denoising step. Our three-stage recipe combines high-resolution continual training, reinforcement learning (RL) post-training, and a final one-step distillation. We introduce Refiner-Bench, a video refinement benchmark constructed from the outputs of different video generators, and use a shared-input protocol to compare refiners at approximately 2K output resolution. At 2K, the one-step SoL-Refiner outperforms all external refiners on the VBench and UniPercept averages, while at $3840\!\times\!2176$ it improves both metrics over the three-step LTX-2.3 Refiner. With the complete acceleration stack, SoL-Refiner achieves an $8.91\times$ speedup in refinement latency over the same baseline in our 2K latency setting.