MVLight: Relightable Text-to-3D Generation via Light-conditioned Multi-View Diffusion

Dongseok Shim, Yichun Shi, Kejie Li, H. Jin Kim, Peng Wang
11/18/2024
cs.CV

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

Recent advancements in text-to-3D generation, building on the success of high-performance text-to-image generative models, have made it possible to create imaginative and richly textured 3D objects from textual descriptions. However, a key challenge remains in effectively decoupling light-independent and lighting-dependent components to enhance the quality of generated 3D models and their relighting performance. In this paper, we present MVLight, a novel light-conditioned multi-view diffusion model that explicitly integrates lighting conditions directly into the generation process. This enables the model to synthesize high-quality images that faithfully reflect the specified lighting environment across multiple camera views. By leveraging this capability to Score Distillation Sampling (SDS), we can effectively synthesize 3D models with improved geometric precision and relighting capabilities. We validate the effectiveness of MVLight through extensive experiments and a user study.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{shim2024mvlight,
  title  = {MVLight: Relightable Text-to-3D Generation via Light-conditioned Multi-View Diffusion},
  author = {Dongseok Shim and Yichun Shi and Kejie Li and H. Jin Kim and Peng Wang},
  year   = {2024},
  eprint = {2411.11475},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2411.11475v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2411.11475.svg)](https://codeofpaper.com/paper/2411.11475)

Discussion