Papers for

security video analysts

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

AlbumVSR improves face video clarity using personal photos

AlbumVSR: Identity-Preserving Face Video Super-Resolution from a Personal Photo Album

Abstract: Severe blur, downsampling, noise, and compression can erase the identity cues needed to faithfully restore a person's face. We therefore use photographs of the same person as an external source of identity. AlbumVSR conditions a frozen, one-step streaming diffusion transformer on a personal album. We use four MagFace/CLIP set tokens to encode the album, and 64 texture tokens which come from a fused UV atlas rendered at the current window's estimated face pose. These tokens are appended to the transformer's cached cross-attention context. On an identity-disjoint VoxCeleb2 benchmark with heavy synthetic degradation, AlbumVSR raises ArcFace similarity to the ground truth from 0.586 to 0.670 and face PSNR from 24.98 to 26.71 dB. On the 91 test identities, its mean identity similarity is higher than that of all 14 baselines.

Wed 28 OctComputer Vision and Pattern Recognition
The gist
Faces in blurry or low-quality videos can lose details that help recognize who they are. The authors created AlbumVSR, a method that uses clear photos of a person from their photo album to help restore their face in videos. It combines this extra identity info with a special transformer model that focuses on the person's pose and appearance. This approach made faces in test videos look more like the real person, recovering details better than previous methods.
Open → 2610.39001v1

Video restoration improves by preserving temporal noise correlations

Taming Noise Initialization for Zero-shot Video Restoration with Image Diffusion Priors

Abstract: Recent advances in diffusion models have achieved remarkable success in restoring high-quality images in a zero-shot manner. Unfortunately, extending this success to video restoration is challenging due to the substantial computational resources required to pre-train video diffusion models. A rising trend seeks to address video restoration by utilizing a pre-trained image diffusion model, initiating restoration from either frame-wise independent or identical Gaussian noise. Yet, these approaches often fall short, as such simple noise initiations fail to capture and utilize the inherent temporal correlations within degraded video frames. In this work, we propose taming noise initialization for zero-shot video restoration, which preserves the intrinsic temporal correlations by generating initial noises directly using DDIM inversion on the corrupted video frames themselves. Building on this, we introduce an adaptive noise blending strategy that suppresses degradation patterns encoded during DDIM inversion while gradually steering the noise toward a Gaussian distribution. To further emphasize temporal consistency, we propose measurement-guided trajectory attention to better align features across frames. Extensive experiments on multiple video restoration tasks demonstrate that our method outperforms existing zero-shot approaches, consistently achieving superior results on the DAVIS, REDS4, and Set8 datasets.

Tue 27 OctComputer Vision and Pattern Recognition
The gist
Fixing damaged video frames is harder than fixing images because video frames are related to each other over time. The authors show that starting the fixing process with smarter noise patterns that keep these time links helps restore videos better. They use a method called DDIM inversion to create these noises based on the damaged video itself, then slowly adjust the noise to make restoration more effective. They also add a way to improve how the computer pays attention to details between frames for smoother results. Their approach works better on popular video test sets than earlier methods.
Open → 2610.37290v1