Progressively Deformable 2D Gaussian Splatting for Video Representation at Arbitrary Resolutions

Mufan Liu, Qi Yang, Miaoran Zhao, He Huang, Le Yang +2 more
3/7/2025
cs.CV

No official code found. Best implementation: Evan-sudo/D2GV (58 stars, last commit 2025-03-13).

Abstract

Implicit neural representations (INRs) enable fast video compression and effective video processing, but a single model rarely offers scalable decoding across rates and resolutions. In practice, multi-resolution typically relies on retraining or multi-branch designs, and structured pruning failed to provide a permutation-invariant progressive transmission order. Motivated by the explicit structure and efficiency of Gaussian splatting, we propose D2GV-AR, a deformable 2D Gaussian video representation that enables \emph{arbitrary-scale} rendering and \emph{any-ratio} progressive coding within a single model. We partition each video into fixed-length Groups of Pictures and represent each group with a canonical set of 2D Gaussian primitives, whose temporal evolution is modeled by a neural ordinary differential equation. During training and rendering, we apply scale-aware grouping according to Nyquist sampling theorem to form a nested hierarchy across resolutions. Once trained, primitives can be pruned via a D-optimal subset objective to enable any-ratio progressive coding. Extensive experiments show that D2GV-AR renders at over 250 FPS while matching or surpassing recent INR baselines, enabling multiscale continuous rate--quality adaptation.

View on arXivView PDF

Code Implementations(1)

Evan-sudo/D2GVCommunity100%

☀️[ArXiv 2025] PyTorch Implementation of D2GV: Deformable 2D Gaussian Splatting for Video Representation in 400FPS

581C, C++Mar 7, 20251 years ago

Cite this paper

@article{liu2025progressively,
  title  = {Progressively Deformable 2D Gaussian Splatting for Video Representation at Arbitrary Resolutions},
  author = {Mufan Liu and Qi Yang and Miaoran Zhao and He Huang and Le Yang and Zhu Li and Yiling Xu},
  year   = {2025},
  eprint = {2503.05600},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2503.05600v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2503.05600.svg)](https://codeofpaper.com/paper/2503.05600)

Discussion