InterDance:Reactive 3D Dance Generation with Realistic Duet Interactions

Ronghui Li, Youliang Zhang, Yachao Zhang, Yuxiang Zhang, Mingyang Su +4 more
12/22/2024
cs.CVcs.GRcs.MM

No confident code implementation found for this paper.

Abstract

Humans perform a variety of interactive motions, among which duet dance is one of the most challenging interactions. However, in terms of human motion generative models, existing works are still unable to generate high-quality interactive motions, especially in the field of duet dance. On the one hand, it is due to the lack of large-scale high-quality datasets. On the other hand, it arises from the incomplete representation of interactive motion and the lack of fine-grained optimization of interactions. To address these challenges, we propose, InterDance, a large-scale duet dance dataset that significantly enhances motion quality, data scale, and the variety of dance genres. Built upon this dataset, we propose a new motion representation that can accurately and comprehensively describe interactive motion. We further introduce a diffusion-based framework with an interaction refinement guidance strategy to optimize the realism of interactions progressively. Extensive experiments demonstrate the effectiveness of our dataset and algorithm.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{li2024interdancereactive,
  title  = {InterDance:Reactive 3D Dance Generation with Realistic Duet Interactions},
  author = {Ronghui Li and Youliang Zhang and Yachao Zhang and Yuxiang Zhang and Mingyang Su and Jie Guo and Ziwei Liu and Yebin Liu and Xiu Li},
  year   = {2024},
  eprint = {2412.16982},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2412.16982v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2412.16982.svg)](https://codeofpaper.com/paper/2412.16982)

Discussion