Gaussian3Diff: 3D Gaussian Diffusion for 3D Full Head Synthesis and Editing

Yushi Lan, Feitong Tan, Di Qiu, Qiangeng Xu, Kyle Genova +6 more
12/5/2023
cs.CVcs.GRcs.LG

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

We present a novel framework for generating photorealistic 3D human head and subsequently manipulating and reposing them with remarkable flexibility. The proposed approach leverages an implicit function representation of 3D human heads, employing 3D Gaussians anchored on a parametric face model. To enhance representational capabilities and encode spatial information, we embed a lightweight tri-plane payload within each Gaussian rather than directly storing color and opacity. Additionally, we parameterize the Gaussians in a 2D UV space via a 3DMM, enabling effective utilization of the diffusion model for 3D head avatar generation. Our method facilitates the creation of diverse and realistic 3D human heads with fine-grained editing over facial features and expressions. Extensive experiments demonstrate the effectiveness of our method.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{lan2023gaussiandiff,
  title  = {Gaussian3Diff: 3D Gaussian Diffusion for 3D Full Head Synthesis and Editing},
  author = {Yushi Lan and Feitong Tan and Di Qiu and Qiangeng Xu and Kyle Genova and Zeng Huang and Sean Fanello and Rohit Pandey and Thomas Funkhouser and Chen Change Loy and Yinda Zhang},
  year   = {2023},
  eprint = {2312.03763},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2312.03763v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2312.03763.svg)](https://codeofpaper.com/paper/2312.03763)

Discussion