AnthroNet: Conditional Generation of Humans via Anthropometrics

Francesco Picetti, Shrinath Deshpande, Jonathan Leban, Soroosh Shahtalebi, Jay Patel +12 more
9/7/2023
cs.CVcs.AIcs.LG

Official code: Unity-Technologies/com.unity.cv.synthetichumans (117 stars, last commit 2023-09-06). 1 more implementation below.

Abstract

We present a novel human body model formulated by an extensive set of anthropocentric measurements, which is capable of generating a wide range of human body shapes and poses. The proposed model enables direct modeling of specific human identities through a deep generative architecture, which can produce humans in any arbitrary pose. It is the first of its kind to have been trained end-to-end using only synthetically generated data, which not only provides highly accurate human mesh representations but also allows for precise anthropometry of the body. Moreover, using a highly diverse animation library, we articulated our synthetic humans' body and hands to maximize the diversity of the learnable priors for model training. Our model was trained on a dataset of $100k$ procedurally-generated posed human meshes and their corresponding anthropometric measurements. Our synthetic data generator can be used to generate millions of unique human identities and poses for non-commercial academic research purposes.

View on arXivView PDF

Code Implementations(2)

A package for creating Unity Perception compatible synthetic people.

11723C#, Jupyter NotebookOct 18, 20223 years agoNOASSERTION
billing-7054owner-computer-vision

Unity's Privacy-Preserving Novel Human Body Model Trained Solely on Synthetic Data and Corresponding Dense Anthropometric Measurements

401Rich Text FormatMar 7, 20233 years agoNOASSERTION
applied-machine-learningapplied-ml-researchbilling-7054computer-graphicscomputer-vision+11 more

Similar Papers

Cite this paper

@article{picetti2023anthronet,
  title  = {AnthroNet: Conditional Generation of Humans via Anthropometrics},
  author = {Francesco Picetti and Shrinath Deshpande and Jonathan Leban and Soroosh Shahtalebi and Jay Patel and Peifeng Jing and Chunpu Wang and Charles Metze and Cameron Sun and Cera Laidlaw and James Warren and Kathy Huynh and River Page and Jonathan Hogins and Adam Crespi and Sujoy Ganguly and Salehe Erfanian Ebadi},
  year   = {2023},
  eprint = {2309.03812},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2309.03812v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2309.03812.svg)](https://codeofpaper.com/paper/2309.03812)

Discussion