TextDestroyer: A Training- and Annotation-Free Diffusion Method for Destroying Anomal Text from Images

Mengcheng Li, Fei Chao
11/1/2024
cs.CVcs.AIcs.LG

No confident code implementation found for this paper.

Abstract

In this paper, we propose TextDestroyer, the first training- and annotation-free method for scene text destruction using a pre-trained diffusion model. Existing scene text removal models require complex annotation and retraining, and may leave faint yet recognizable text information, compromising privacy protection and content concealment. TextDestroyer addresses these issues by employing a three-stage hierarchical process to obtain accurate text masks. Our method scrambles text areas in the latent start code using a Gaussian distribution before reconstruction. During the diffusion denoising process, self-attention key and value are referenced from the original latent to restore the compromised background. Latent codes saved at each inversion step are used for replacement during reconstruction, ensuring perfect background restoration. The advantages of TextDestroyer include: (1) it eliminates labor-intensive data annotation and resource-intensive training; (2) it achieves more thorough text destruction, preventing recognizable traces; and (3) it demonstrates better generalization capabilities, performing well on both real-world scenes and generated images.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{li2024textdestroyer,
  title  = {TextDestroyer: A Training- and Annotation-Free Diffusion Method for Destroying Anomal Text from Images},
  author = {Mengcheng Li and Fei Chao},
  year   = {2024},
  eprint = {2411.00355},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2411.00355v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2411.00355.svg)](https://codeofpaper.com/paper/2411.00355)

Discussion