Sign In

[Simple+Advanced] FLUX.1 ComfyUI Workflows

232
8.6k
97
Updated: Aug 8, 2024
base modelcomfyuifluxflux.1
Type
Workflows
Stats
5,329
Reviews
Published
Aug 7, 2024
Base Model
Flux.1 D
Hash
AutoV2
030000A2F4
Werewolf Pup
markury's Avatar
markury
The FLUX.1 [dev] Model is licensed by Black Forest Labs. Inc. under the FLUX.1 [dev] Non-Commercial License. Copyright Black Forest Labs. Inc.
IN NO EVENT SHALL BLACK FOREST LABS, INC. BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH USE OF THIS MODEL.

This workflow allows you to harness the power of FLUX.1 [dev] within ComfyUI. Follow these steps to set up and run the model.

The true "simplest" version of a Flux workflow can be found here, but it uses the FP8 version which is slightly worse. For that reason, I do not use the "Load Checkpoint" node version of the workflow.

Note: To train LoRAs, see my video guide here: https://civitai.com/articles/6533/how-to-train-a-lora-for-flux1-dev-with-simpletuner

Instructions:

  1. Model Placement:

    • Place the FLUX.1 [dev] checkpoint in ComfyUI/models/unet (not in checkpoints folder)

  2. Download Required Files:

  3. Low VRAM Setup:

    • Launch ComfyUI with the "--lowvram" argument (add to your .bat file) to offload the text encoder to CPU

  4. Performance Notes:

    • Confirmed to run on:

      • RTX 3090 (24GB): 1.29s/it

      • RTX 4070 (12GB): 85s/it

    • Both tests used the FP8 quantized version. Note that the 4070 is significantly slower.

  5. Preview Setup:

    • Update your ComfyUI to the latest version

    • In the Manager menu, set "Preview Method" to "Auto"

Using the Workflow

  1. Load the provided workflow file into ComfyUI

  2. Adjust your prompts and parameters as desired

  3. Run the workflow to generate images

Note: This workflow includes a custom node for metadata. It can run in vanilla ComfyUI, but you may need to adjust the workflow if you don't have this custom node installed.

Introduction to FLUX.1 [dev]

FLUX.1 [dev] is a groundbreaking 12 billion parameter rectified flow transformer for text-to-image generation, developed by Black Forest Labs. As part of the innovative FLUX.1 suite of models, it represents a significant leap forward in image synthesis technology, offering:

  • State-of-the-art image quality and prompt adherence

  • Competitive performance with closed-source alternatives

  • Enhanced efficiency through guidance distillation training

  • Support for diverse aspect ratios and resolutions (0.1 to 2.0 megapixels)

Black Forest Labs, founded by distinguished AI researchers and engineers, brings a wealth of experience from developing foundational generative AI models like VQGAN, Latent Diffusion, and Stable Diffusion. FLUX.1 [dev] showcases their commitment to pushing the boundaries of AI-generated imagery.

License and Usage

FLUX.1 [dev] is released under a non-commercial license. Please refer to the official FLUX.1 [dev] license for full terms and conditions. This model is intended for research, personal projects, and non-commercial use only.

Enjoy exploring the capabilities of FLUX.1 [dev] with this ComfyUI workflow!