The Role of Text-to-Image Models in Advanced Style Transfer Applications: A Case Study with DALL-E 3

Ebubechukwu Ike
12/4/2024
cs.CVeess.IV

No confident code implementation found for this paper. 4 possible matches can be shown below.

Abstract

While DALL-E 3 has gained popularity for its ability to generate creative and complex images from textual descriptions, its application in the domain of style transfer remains slightly underexplored. This project investigates the integration of DALL-E 3 with traditional neural style transfer techniques to assess the impact of generated style images on the quality of the final output. DALL-E 3 was employed to generate style images based on the descriptions provided and combine these with the Magenta Arbitrary Image Stylization model. This integration is evaluated through metrics such as the Structural Similarity Index Measure (SSIM) and Peak Signal-to-Noise Ratio (PSNR), as well as processing time assessments. The findings reveal that DALL-E 3 significantly enhances the diversity and artistic quality of stylized images. Although this improvement comes with a slight increase in style transfer time, the data shows that this trade-off is worthwhile because the overall processing time with DALL-E 3 is about 2.5 seconds faster than traditional methods, making it both an efficient and visually superior option.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 4 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

InstantStyle-Plus: Style Transfer with Content-Preserving in Text-to-Image Generation

86% match1 repo1562024

An Analysis for Image-to-Image Translation and Style Transfer

85% match2024

ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptation

85% match1 repo342026

Mamba-ST: State Space Model for Efficient Style Transfer

84% match1 repo552024

CreativeSynth: Cross-Art-Attention for Artistic Image Synthesis with Multimodal Diffusion

84% match1 repo422024

Dream-in-Style: Text-to-3D Generation Using Stylized Score Distillation

84% match1 repo32024

Cite this paper

@article{ike2024role,
  title  = {The Role of Text-to-Image Models in Advanced Style Transfer Applications: A Case Study with DALL-E 3},
  author = {Ebubechukwu Ike},
  year   = {2024},
  eprint = {2412.05325},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2412.05325v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2412.05325.svg)](https://codeofpaper.com/paper/2412.05325)

Discussion