Optimizing Negative Prompts for Enhanced Aesthetics and Fidelity in Text-To-Image Generation

Michael Ogezi, Ning Shi
3/12/2024
cs.CVcs.AIcs.LG

No confident code implementation found for this paper. 8 possible matches can be shown below.

Abstract

In text-to-image generation, using negative prompts, which describe undesirable image characteristics, can significantly boost image quality. However, producing good negative prompts is manual and tedious. To address this, we propose NegOpt, a novel method for optimizing negative prompt generation toward enhanced image generation, using supervised fine-tuning and reinforcement learning. Our combined approach results in a substantial increase of 25% in Inception Score compared to other approaches and surpasses ground-truth negative prompts from the test set. Furthermore, with NegOpt we can preferentially optimize the metrics most important to us. Finally, we construct Negative Prompts DB (https://huggingface.co/datasets/mikeogezi/negopt_full), a publicly available dataset of negative prompts.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 8 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{ogezi2024optimizing,
  title  = {Optimizing Negative Prompts for Enhanced Aesthetics and Fidelity in Text-To-Image Generation},
  author = {Michael Ogezi and Ning Shi},
  year   = {2024},
  eprint = {2403.07605},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2403.07605v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2403.07605.svg)](https://codeofpaper.com/paper/2403.07605)

Discussion