Video deraining improves by adapting restoration to uncertainty
Selective Generative Restoration for Video Deraining via Uncertainty-Aware Diffusion
Computer Vision and Pattern Recognition
Summary
Cleaning rain from videos is tricky because some parts need careful restoration while others are too blurry or covered to fix directly. The authors developed a method that guesses how confident it can be about each part of the video and uses a special process to either keep what it sees or recreate missing details where needed. This approach prevents unnatural smoothness or random guessing and keeps the video looking natural and consistent across frames. Their system also runs efficiently, making it practical for real use.
What this means in practice
- •For video post-production teams: Improve the quality of rain-affected footage by applying selective restoration that balances detail preservation and generative refinement for more natural results.
- •For autonomous vehicle system developers: Enhance video sensor input clarity during rainy conditions by adapting restoration intensity based on uncertainty, reducing visual artifacts and improving perception.
Authors
Yi'ang Chen, Han Li, Laibin Chang, Hui Liu, Kui Jiang, Junjun Jiang
Abstract
Video deraining is challenging due to rain streaks, occlusions, and atmospheric effects. Existing methods mainly follow a deterministic restoration paradigm, assuming that clean scenes can be uniquely recovered from rainy observations. However, rain degradation is spatially heterogeneous. Reliable regions require faithful reconstruction, whereas severely occluded regions contain ambiguous content that require stronger prior-driven inference. Therefore, conventional deterministic restoration often produces over-smoothed results, while global generative restoration may introduce unnecessary hallucinations. We introduce a Selective Generative Restoration paradigm for video deraining, where generative priors are adaptively activated according to restoration uncertainty. Based on this principle, we propose Selective Generative Video Deraining (SGVD), an uncertainty-aware diffusion framework that enables adaptive fidelity preservation and generative recovery. Specifically, SGVD exploits stochastic diversity between dual one-step diffusion predictions to estimate region-level restoration uncertainty, which determines where observation fidelity should be preserved and where generative inference should be activated. Furthermore, an anchor-guided trajectory consistency mechanism is proposed to regularize stochastic diffusion evolution across frames, reducing temporal generation drift and improving video coherence. To achieve practical efficiency, SGVD adopts one-step diffusion inference while maintaining uncertainty-aware generative capability. Extensive experiments demonstrate that SGVD achieves superior restoration performance, perceptual quality, and temporal consistency compared with state-of-the-art video deraining methods.