ProGraph: Temporally-alignable Probability Guided Graph Topological Modeling for 3D Human Reconstruction

Hongsheng Wang, Zehui Feng, Tong Xiao, Genfan Yang, Shengyu Zhang +2 more
11/7/2024
cs.CV

No confident code implementation found for this paper.

Abstract

Current 3D human motion reconstruction methods from monocular videos rely on features within the current reconstruction window, leading to distortion and deformations in the human structure under local occlusions or blurriness in video frames. To estimate realistic 3D human mesh sequences based on incomplete features, we propose Temporally-alignable Probability Guided Graph Topological Modeling for 3D Human Reconstruction (ProGraph). For missing parts recovery, we exploit the explicit topological-aware probability distribution across the entire motion sequence. To restore the complete human, Graph Topological Modeling (GTM) learns the underlying topological structure, focusing on the relationships inherent in the individual parts. Next, to generate blurred motion parts, Temporal-alignable Probability Distribution (TPDist) utilizes the GTM to predict features based on distribution. This interactive mechanism facilitates motion consistency, allowing the restoration of human parts. Furthermore, Hierarchical Human Loss (HHLoss) constrains the probability distribution errors of inter-frame features during topological structure variation. Our Method achieves superior results than other SOTA methods in addressing occlusions and blurriness on 3DPW.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{wang2024prograph,
  title  = {ProGraph: Temporally-alignable Probability Guided Graph Topological Modeling for 3D Human Reconstruction},
  author = {Hongsheng Wang and Zehui Feng and Tong Xiao and Genfan Yang and Shengyu Zhang and Fei Wu and Feng Lin},
  year   = {2024},
  eprint = {2411.04399},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2411.04399v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2411.04399.svg)](https://codeofpaper.com/paper/2411.04399)

Discussion