Move and Act: Enhanced Object Manipulation and Background Integrity for Image Editing

Pengfei Jiang, Mingbao Lin, Fei Chao
7/25/2024
cs.CV

Official code: mobiushy/move-act (11 stars, last commit 2024-07-26).

Abstract

Current methods commonly utilize three-branch structures of inversion, reconstruction, and editing, to tackle consistent image editing task. However, these methods lack control over the generation position of the edited object and have issues with background preservation. To overcome these limitations, we propose a tuning-free method with only two branches: inversion and editing. This approach allows users to simultaneously edit the object's action and control the generation position of the edited object. Additionally, it achieves improved background preservation. Specifically, we transfer the edited object information to the target area and repair or preserve the background of other areas during the inversion process at a specific time step. In the editing stage, we use the image features in self-attention to query the key and value of the corresponding time step in the inversion to achieve consistent image editing. Impressive image editing results and quantitative evaluation demonstrate the effectiveness of our method. The code is available at https://github.com/mobiushy/move-act.

View on arXivView PDF

Code Implementations(1)

mobiushy/move-actOfficial100%
110PythonJul 21, 20242 years ago

Similar Papers

Cite this paper

@article{jiang2024move,
  title  = {Move and Act: Enhanced Object Manipulation and Background Integrity for Image Editing},
  author = {Pengfei Jiang and Mingbao Lin and Fei Chao},
  year   = {2024},
  eprint = {2407.17847},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.17847v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.17847.svg)](https://codeofpaper.com/paper/2407.17847)

Discussion