Sign In

Step-by-Step Guide Series: ComfyUI - IMG to IMG

21
Step-by-Step Guide Series: ComfyUI - IMG to IMG

Step-by-Step Guide Series:
ComfyUI - IMG to IMG Workflow

This article accompanies this workflow: link

Workflow description :

The aim of this workflow is to generate images from another one and a text in a simple window.

Prerequisites :

📂Files for "base" version :

Model : flux1-dev-x.safetensors
in ComfyUI\models\unet

VAE : ae.safetensors
in \ComfyUI\models\vae

CLIP : t5xxl_fp8_e4m3fn.safetensors and clip_l.safetensors
in \ComfyUI\models\clip

📂Files for GGUF version :

Recommendation :
24 gb Vram: Q8_0
16 gb Vram: Q5_K_S
<12 gb Vram: Q4_K_S

GGUF_Model : flux1-dev-QX_0.gguf
in ComfyUI\models\unet

GGUF_clip : t5-v1_1-xxl-encoder-QX_0.gguf
in \ComfyUI\models\clip

Text encoder : ViT-L-14-TEXT-detail-improved-hiT-GmP-TE-only-HF.safetensors
in \ComfyUI\models\clip

VAE : ae.safetensors
in \ComfyUI\models\vae

ANY upscale model :

in models/upscale_models

📦Custom Nodes :

Don't forget to close the workflow and open it again once the nodes have been installed.

Usage :

In this new version of the workflow everything is organized by color:

  • Green is what you want to create, also called prompt,

  • Yellow is all the parameters to adjust the video,

  • Blue are the model files used by the workflow,

  • Purple is for LoRA.

We will now see how to use each node:

Write what you want in the “Prompt” node :

Select image format :

Choose the guidance level :

I recommend between 3.5 and 4.5. The lower the number, the freer you leave the model. The higher the number, the more the image will resemble what you “strictly” asked for.

Choose a scheduler, number of steps and denoise level :

I recommend normal or beta and between 20 and 30. The higher the number, the better the quality, but the longer it takes to get an image.

The denoise allows you to choose how the base image will influence the new one. At 0, the image will be exactly the same (useless), and at 1, the image will be completely new (so your image will be ignored).

I recommend starting around 0.7/0.8 and reducing or increasing it depending on the desired result.

Choose a sampler :

I recommend euler.

Define a seed or let comfy generate one:

Add how many LoRA you want to use, and define it :

If you dont know what is LoRA just dont active any.

Load your base image :

Choose your model:

Depending on whether you've chosen basic or gguf workflow, this setting changes. I personally use the gguf Q8_0 version.

Choose a FLUX clip encoder and a text encoder :

I personally use the GGUF Q8_0 encoder and the text encoder ViT-L-14-TEXT-detail-improved-hiT-GmP-TE-only-HF.

Select an upscaler : (optional)

I personally use RealESRGAN_x4plus.pth.

Select upscale ratio : (optional)

This is the multiplier that will be used by the upscaler, with 2 the image will be twice as large.

Now you're ready to create your image.

Just click on the “Queue” button to start:

Once rendering is complete, the image appears in the “image viewer” node.

If you have enabled upscaling, a slider will show the base image and the upscaled version.

This guide is now complete. If you have any questions or suggestions, don't hesitate to post a comment.

21

Comments