Integrating View Conditions for Image Synthesis

Jinbin Bai, Zhen Dong, Aosong Feng, Xiao Zhang, Tian Ye +1 more
10/24/2023
cs.CV

No official code found. Best implementation: collovlabs/ViewControl (25 stars, Apache-2.0, last commit 2024-08-27).

Abstract

In the field of image processing, applying intricate semantic modifications within existing images remains an enduring challenge. This paper introduces a pioneering framework that integrates viewpoint information to enhance the control of image editing tasks, especially for interior design scenes. By surveying existing object editing methodologies, we distill three essential criteria -- consistency, controllability, and harmony -- that should be met for an image editing method. In contrast to previous approaches, our framework takes the lead in satisfying all three requirements for addressing the challenge of image synthesis. Through comprehensive experiments, encompassing both quantitative assessments and qualitative comparisons with contemporary state-of-the-art methods, we present compelling evidence of our framework's superior performance across multiple dimensions. This work establishes a promising avenue for advancing image synthesis techniques and empowering precise object modifications while preserving the visual coherence of the entire composition.

View on arXivView PDF

Code Implementations(1)

Apache-2.0

[IJCAI 2024] Official implementation of the paper "Integrating View Conditions for Image Synthesis"

253PythonOct 18, 20232 years agoApache-2.0
content-creationcontrollabilityimage-editing

Similar Papers

Cite this paper

@article{bai2023integrating,
  title  = {Integrating View Conditions for Image Synthesis},
  author = {Jinbin Bai and Zhen Dong and Aosong Feng and Xiao Zhang and Tian Ye and Kaicheng Zhou},
  year   = {2023},
  eprint = {2310.16002},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2310.16002v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2310.16002.svg)](https://codeofpaper.com/paper/2310.16002)

Discussion