Papers for

video streaming providers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Real-time video compression using deformable 2D Gaussian splatting

Deformable 2D Gaussian Splatting for Efficient 4K Video Compression

Abstract: Ultra-High-Definition (UHD) video presents significant challenges for efficient storage and real-time decoding. Learning-based methods, such as Neural Video Compression (NVC) and Implicit Neural Representations (INR), achieve competitive rate-distortion performance but suffer from high decoding latency and excessive memory usage. Meanwhile, Gaussian Splatting has recently attracted attention in the computer graphics community due to its ultra-fast rendering and high-fidelity visual quality. Despite these advantages, its application in video compression remains largely unexplored. To bridge this gap, we propose a real-time video compression framework that represents and compresses a Group of Pictures (GOP) using a coarse-to-fine multi-scale 2D Gaussian Splatting (2DGS) structure coupled with a lightweight deformation network. Experiments demonstrate that our method delivers rate-distortion performance in LPIPS that surpasses H.265 and other state-of-the-art learning-based video compression methods. Our work demonstrates the potential of Gaussian Splatting as a practical solution for efficient high-resolution video compression.

Sat 12 SeptComputer Vision and Pattern Recognition
The gist
Ultra-high-definition videos require a lot of storage and are slow to decode in real time. The authors propose a new way to compress videos by using a 2D Gaussian Splatting method combined with a lightweight deformation network. This approach can compress groups of video frames quickly and efficiently, resulting in better video quality compared to the popular H.265 standard and other recent AI-based methods. Their method is especially suited for very high-resolution videos, like 4K.
Open → 2609.14129v1