MoRF: Mobile Realistic Fullbody Avatars from a Monocular Video

Renat Bashirov, Alexey Larionov, Evgeniya Ustinova, Mikhail Sidorenko, David Svitov +2 more
3/17/2023
cs.CV

No confident code implementation found for this paper.

Abstract

We present a system to create Mobile Realistic Fullbody (MoRF) avatars. MoRF avatars are rendered in real-time on mobile devices, learned from monocular videos, and have high realism. We use SMPL-X as a proxy geometry and render it with DNR (neural texture and image-2-image network). We improve on prior work, by overfitting per-frame warping fields in the neural texture space, allowing to better align the training signal between different frames. We also refine SMPL-X mesh fitting procedure to improve the overall avatar quality. In the comparisons to other monocular video-based avatar systems, MoRF avatars achieve higher image sharpness and temporal consistency. Participants of our user study also preferred avatars generated by MoRF.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{bashirov2023morf,
  title  = {MoRF: Mobile Realistic Fullbody Avatars from a Monocular Video},
  author = {Renat Bashirov and Alexey Larionov and Evgeniya Ustinova and Mikhail Sidorenko and David Svitov and Ilya Zakharkin and Victor Lempitsky},
  year   = {2023},
  eprint = {2303.10275},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2303.10275v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2303.10275.svg)](https://codeofpaper.com/paper/2303.10275)

Discussion