[Simple+Advanced] FLUX.1 ComfyUI Workflows

This workflow allows you to harness the power of FLUX.1 [dev] within ComfyUI. Follow these steps to set up and run the model.

The true "simplest" version of a Flux workflow can be found here, but it uses the FP8 version which is slightly worse. For that reason, I do not use the "Load Checkpoint" node version of the workflow.

Note: To train LoRAs, see my video guide here: https://civitai.com/articles/6533/how-to-train-a-lora-for-flux1-dev-with-simpletuner

Instructions:

1. Model Placement:

   • Place the FLUX.1 [dev] checkpoint in ComfyUI/models/unet (not in checkpoints folder)

2. Download Required Files:

   • Original weights: flux1-dev.sft

   • FP8 version (for <24GB VRAM systems): flux1-dev-fp8.safetensors

   • Text encoders (place in ComfyUI/models/clip): flux_text_encoders

   • VAE (place ae.sft in ComfyUI/models/vae): ae.sft

   • For lower RAM usage, download the FP8 T5XXL encoder (with some quality degradation)

3. Low VRAM Setup:

   • Launch ComfyUI with the "--lowvram" argument (add to your .bat file) to offload the text encoder to CPU

4. Performance Notes:

   • Confirmed to run on:

     • RTX 3090 (24GB): 1.29s/it

     • RTX 4070 (12GB): 85s/it

   • Both tests used the FP8 quantized version. Note that the 4070 is significantly slower.

5. Preview Setup:

   • Update your ComfyUI to the latest version

   • In the Manager menu, set "Preview Method" to "Auto"

Using the Workflow

1. Load the provided workflow file into ComfyUI

2. Adjust your prompts and parameters as desired

3. Run the workflow to generate images

Note: This workflow includes a custom node for metadata. It can run in vanilla ComfyUI, but you may need to adjust the workflow if you don't have this custom node installed.

Introduction to FLUX.1 [dev]

FLUX.1 [dev] is a groundbreaking 12 billion parameter rectified flow transformer for text-to-image generation, developed by Black Forest Labs. As part of the innovative FLUX.1 suite of models, it represents a significant leap forward in image synthesis technology, offering:

• State-of-the-art image quality and prompt adherence

• Competitive performance with closed-source alternatives

• Enhanced efficiency through guidance distillation training

• Support for diverse aspect ratios and resolutions (0.1 to 2.0 megapixels)

Black Forest Labs, founded by distinguished AI researchers and engineers, brings a wealth of experience from developing foundational generative AI models like VQGAN, Latent Diffusion, and Stable Diffusion. FLUX.1 [dev] showcases their commitment to pushing the boundaries of AI-generated imagery.

License and Usage

FLUX.1 [dev] is released under a non-commercial license. Please refer to the official FLUX.1 [dev] license for full terms and conditions. This model is intended for research, personal projects, and non-commercial use only.

Enjoy exploring the capabilities of FLUX.1 [dev] with this ComfyUI workflow!