Papers for

video streaming teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

FlashVSR plus boosts video resolution efficiently with new attention and training

FlashVSR+: Efficient Video Super-Resolution via Hybrid Attention and Reward-Yield Distribution Matching

Abstract: Recent video super-resolution (VSR) models achieve efficient one-step generation through diffusion distillation. However, high-resolution inference remains costly, and distilled models are difficult to align with human preferences. These challenges call for improvements in both model architecture and training strategy. We present \textbf{FlashVSR+} to address both limitations. On the architecture side, we introduce hybrid attention based on the strong locality observed in pretrained VSR models, while retaining sparse global interaction for long-range consistency. It achieves up to $2\times$ DiT speedup and 45\% lower peak memory, enabling spatially untiled 4K VSR on a single 24GB RTX 4090. On the training side, we propose Reward-Yield Distribution Matching Distillation (Ry-DMD) for preference-aligned one-step generation. Ry-DMD uses reward-weighted teacher rollouts to incorporate black-box rewards into distribution matching, without backpropagating through the reward model. We further show that Ry-DMD generalizes beyond VSR to T2I generation. Together, FlashVSR+ delivers stronger restoration quality and substantially improves high-resolution efficiency, with consistent gains in user preference. We release our code, models, and training data at \href{https://www.flashvsr.tech}{\textcolor{FlashBlue}{\textbf{www.flashvsr.tech}}}.

Tue 13 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Video super-resolution means making low-quality videos look clearer and sharper. The researchers developed FlashVSR+, a new method that speeds up this process and reduces the computer memory it uses, even for very large videos like 4K. They also created a training technique to make the improved videos better match what people prefer to see. Together, these changes let computers enhance video quality faster and more efficiently than before.
Open → 2610.17552v1

Jacobian lens distance measures image similarity more like humans do

JLD: Perceptual Distance Through A Jacobian Lens

Abstract: Image compression, restoration, and generation all require a way to measure how different two images look to a person. Pixel error ignores how people see, while the most accurate perceptual distances are typically fitted to human judgments, tying them to a fixed data and resolution. For example, when image resolution is doubled, the correlation of DISTS with human scores on TID2013 drops from 0.815 to 0.717. We introduce the Jacobian Lens Distance (JLD), which derives its perceptual geometry from a frozen vision encoder rather than from human labels. JLD combines the locality of early patch features with the perceptual sensitivity captured by later encoder representations. Specifically, we use the encoder Jacobian to identify directions in the early feature space that most strongly affect the encoder output, producing a fixed metric tensor, $E[J^\top J]$, which we call the Jacobian lens. The lens is fitted only once from 100 unlabeled images, taking about 35 seconds. Locally, this construction defines a pullback metric in pixel space, giving JLD a clear geometric interpretation that can be directly analyzed on real images. Across four standard perceptual databases, JLD achieves state-of-the-art performance and consistently outperforms LPIPS, DISTS, PieAPP, and DreamSim. JLD is also robust to changes in image resolution, on TID2013, its lens-term correlation remains nearly unchanged when the resolution is doubled, decreasing only from 0.850 to 0.845. We further introduce JLD-fast, which is $4\times$ faster than LPIPS-VGG while achieving a mean correlation of 0.911. Finally, JLD naturally extends to video, reaching a correlation of 0.786 on Waterloo IVC 4K compared with 0.611 for VMAF.

Mon 5 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Measuring how different two images look to people is tricky because simple pixel differences don’t match human perception well. The authors created a new way to measure this difference, called Jacobian Lens Distance (JLD), which uses features from a fixed vision model to capture what humans tend to notice. Unlike previous methods that rely on human-labeled data, JLD is built from the internal workings of a vision encoder and works well even when image resolution changes. It performs better on several tests than existing methods and runs faster in a simplified variant.
Open → 2610.05967v1

Successive refinement coding improves perception with common randomness

Successive Refinement Under Strong-Sense Perfect Perception

Abstract: We revisit a multiterminal lossy source coding problem named successive refinement and derive the rate-distortion-perception region under the strong-sense perfect perception constraint in the presence of unlimited common randomness. Specifically, in successive refinement, one aims to compress a source sequence and allows two distinct decoders to recover the source sequence at different distortion levels. By imposing the strong-sense perfect perception constraint, our results refine the previous result by analyzing the impact of the perceptual quality. Our achievability proof is inspired by output constrained lossy source coding and our converse proof adapts the proof steps of the standard successive refinement problem. Furthermore, we provide a numerical example of the Bernoulli source to illustrate our result and show that the Bernoulli source under Hamming distortion is successively refinable even with the strong-sense perfect perception constraint.

Sun 13 SeptInformation Theory
The gist
This paper studies how to compress information so that two users can recover it at different quality levels, focusing on making the recovered data look perfectly natural to human perception. The authors examine how adding a strong perception constraint affects compression, using a scenario where shared randomness is unlimited. They prove that for a simple type of data called a Bernoulli source, good compression is possible without harming perceptual quality. This work helps clarify how to balance data compression, quality, and natural appearance together.
Open → 2609.14404v1

Semi-tensor product method improves image and video decompositions

Semi-Tensor Product-Based Multi-Term Randomized T-SVD and Its Visual Applications

Abstract: Tensor singular value decomposition (T-SVD), which is built upon the tensor-tensor product (t-product), has emerged as a powerful tool for processing high-dimensional visual data such as color images and videos. However, the standard t-product imposes strict dimensional compatibility constraints. Although extensions based on the semi-tensor product (STP) relax this restriction, their single-term formulations still suffer from limited approximation accuracy. Moreover, these deterministic methods incur high computational costs when processing large-scale tensor data. To address these issues, this paper introduces a novel semi-tensor product for third-order tensors under the t-product framework induced by arbitrary invertible linear transforms. The resulting tensor semi-tensor product breaks the rigid dimension matching requirement of the standard t-product, while retaining the closed-form property of T-SVD. Based on this construction, we develop a multi-term semi-tensor product singular value decomposition (MSTP-SVD), which integrates multiple orthogonal decomposition terms to significantly improve low-rank approximation accuracy compared with single-term schemes. To reduce the computational cost of multi-term modeling, we incorporate randomized projection and power iteration techniques into the MSTP-SVD framework, yielding an accelerated multi-term randomized semi-tensor product SVD (MRSTP-SVD) algorithm that achieves a balance between reconstruction accuracy and computational efficiency. Experiments on image and video compression and completion tasks demonstrate the effectiveness of the proposed method.

Thu 10 SeptMachine Learning
The gist
Working with complex visual data like images and videos is challenging because of strict rules about how data dimensions must line up. The authors design a new way to handle these data that relaxes those rules while keeping useful mathematical properties. They combine multiple pieces in their method to better approximate data and use randomized techniques to speed up calculations. Their approach helps compress and fill in missing parts of images and videos more efficiently.
Open → 2609.11168v1