InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attention

Howard Zhang, Yuval Alaluf, Sizhuo Ma, Achuta Kadambi, Jian Wang +1 more
12/9/2024
cs.CV

No official code found. Best implementation: snap-research/InstantRestore (144 stars, last commit 2025-09-23).

Abstract

Face image restoration aims to enhance degraded facial images while addressing challenges such as diverse degradation types, real-time processing demands, and, most crucially, the preservation of identity-specific features. Existing methods often struggle with slow processing times and suboptimal restoration, especially under severe degradation, failing to accurately reconstruct finer-level identity details. To address these issues, we introduce InstantRestore, a novel framework that leverages a single-step image diffusion model and an attention-sharing mechanism for fast and personalized face restoration. Additionally, InstantRestore incorporates a novel landmark attention loss, aligning key facial landmarks to refine the attention maps, enhancing identity preservation. At inference time, given a degraded input and a small (~4) set of reference images, InstantRestore performs a single forward pass through the network to achieve near real-time performance. Unlike prior approaches that rely on full diffusion processes or per-identity model tuning, InstantRestore offers a scalable solution suitable for large-scale applications. Extensive experiments demonstrate that InstantRestore outperforms existing methods in quality and speed, making it an appealing choice for identity-preserving face restoration.

View on arXivView PDF

Code Implementations(1)

Official Implementation for "InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attention"

1447Shell, PythonDec 8, 20241 years ago
diffusion-modelsface-restoration

Similar Papers

Cite this paper

@article{zhang2024instantrestore,
  title  = {InstantRestore: Single-Step Personalized Face Restoration with Shared-Image Attention},
  author = {Howard Zhang and Yuval Alaluf and Sizhuo Ma and Achuta Kadambi and Jian Wang and Kfir Aberman},
  year   = {2024},
  eprint = {2412.06753},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2412.06753v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2412.06753.svg)](https://codeofpaper.com/paper/2412.06753)

Discussion