Type | Workflows |
Stats | 76 0 |
Reviews | (4) |
Published | Apr 13, 2025 |
Base Model | |
Hash | AutoV2 DF082E9DA4 |
Introduction
πͺ This is my attempt at a flexible and extensible workflow framework in both Flux and SDXL variants. Many customizable pathways are possible to create particular recipes π₯£ from the available components, without unnecessary obfuscation (e.g., noodle convolution, stacking nodes over others, etc.) and arguably capable of rendering results of similar quality to more complicated specialized workflows.
The workflow was developed and tested on the following system:
Operating system: Linux Mint 21.3 Cinnamon with 62 GB RAM
Processor: 11th Gen IntelΒ© Coreβ’ i9-11900 @ 2.50GHz Γ 8
Graphics card: NVIDIA GeForce RTX 3060 with 12 GB VRAM
Browser: Google Chrome
Please report bugs πͺ² or errors π«, as well as successes π€ and requests/suggestions π. Post and share your SFW creations!!! I spent a lot of time working on this project (((for no π°))), so I hope others make good use of it and find it helpful.
New in Version 4
Added Gemini AI, facial expression editor, and Thera upscaler.
Replaced Hunyuan video with Wan 2.1 video:
employs (mostly) native nodes
text-to-video, image-to-video (default), and video-to-video (using ControlNet) options
ControlNet Fun and LoRA models implemented; VACE not yet available
simple upscaling and interpolation
Replaced OmniGen with EasyControl π§, but the current implementation is experimental and exceeding my available VRAM to even run.
MutiGPU loaders now default, except for Wan where they seemed to be a source of instabilities.
Overhauled ControlNets + groups:
simplified Redux
restructured basic ControlNets to allow three different models concurrently
regional control that respects different LoRAs
Cleaned up and improved workflow:
more color-coding of nodes
better organization and sorting of bookmarks
added global seed node
added simple latent operations (between samplers)
fixed default masking bug
upgraded inpainting crop-and-stitch
added model switch, for easier implementation of specialized recipes
Flux
The Flux version 4 is highlighted by Flux Tools π οΈ: Fill (optionally with ACE++), Canny & Depth, and Redux. Basic ControlNets are also available, including regional control, along with two face swap tools (PuLID and ZenID), detailing, relighting, EasyControl π§, facial expression editor, and RF inversion. Additional accessories include four captioners (Florence2, JoyCaption2, WD14 Tagger, and SuperPrompt), three background removers (RemBG, RMBG, and Florence2 + SAM2), XY plots, five upscalers (basic, Thera, InvSR, Ultimate SD, and SUPIR), three video generators (DepthFlow, Sonic for talking avatars, and Wan), and stereoscope. A simple interface for Gemini AI is included. Core 𦴠and lite πͺΆ editions are also available in the package.
SDXL
The SDXL version 4 includes all of the components of the Flux variant, except for Flux Tools, RF inversion, and EasyControl. Core 𦴠and lite πͺΆ editions are also available in the package.
Lightly modified versions of the core 𦴠edition have been confirmed to run the default text-to-image recipe π₯£ on the following models: SD 1.5*, SDXL finetunes: Illustrious, NoobAI, and Pony; SD 3.5; Hunyuan-DiT*; Kolors; PixArt Sigma; and TinyBreaker. [* = may work better w/o --use-sage-attention]
Installation [Flux]
Quick Start
Install or update ComfyUI to the very latest version. Follow your favorite YouTube installation video, if needed.
Install ComfyUI Manager.
Download the following models (or equivalents). Follow the Quickstart Guide to Flux.1, if needed.
Download the FLUX.1-Turbo-Alpha LoRA.
Open the Flux :: Flexi-Workflow in ComfyUI. You may want to start with the lite πͺΆ edition, especially if you are new to ComfyUI.
Use the Manager to Install Missing Custom Nodes. It is recommended to install just a few custom node packages at a time until you get through all of them. You may need to set security_level = normal- (notice the dash/minus!) in the config.ini file to download some custom nodes.
Restart ComfyUI.
Load models (01a) and LoRAs (03c) according to your folder structure.
Run the default text-to-image recipe π₯£.
Enjoy your generated image creations! π
Additional Recommended Installations
For the intended component functionalities, install Flux Tools: Fill, Canny & Depth, and/or Redux. The Redux model also requires sigclip_vision_384.
Other ControlNets, such as X-Lab's Canny and Depth, Shakker-Labs's Union Pro, TheMistoAI's Lineart/Sketch, and/or jasperai's Upscaler and other models, are also (theoretically) supported, although results may vary. (The bdsqlsz and kohya models appear to be incompatible, in limited testing, as they appear to require image dimensions in multiples of 32, which is not guaranteed in the workflow.) Feel free to browse for others.
While you should be prompted to install the necessary custom nodes (~50) via the ComfyUI Manager, I'm listing them here for your reference: A8R8 ComfyUI Nodes (ramyma), AdvancedLivePortrait (PowerHouseMan), bleh (blepping), comfy-plasma (Jordach), Comfyroll Studio (Suzie1)*, ControlAltAI_Nodes (ControlAltAI)*, controlnet_aux (Fannovel16)*, Crystools (Crystian)*, Custom-Scripts (pythongosssss)*, Depthflow-Nodes (Akatz), Detail-Daemon (Jonseed)*, EasyControl (jax-explorer) π§, Easy-Use (yolain)*, essentials (Matteo)*, Fill-Nodes (Machine Delusions), Florence2 (Kijai), FluxSettingsNode (Light_x02)*, Fluxtapoz (logtd), GGUF (city96), GIMM-VFI (kijai), Golden-Noise (LucipherDev), IF_Gemini (impactframes)*, Image-Filters (spacepxl), Impact Pack (Dr.Lt.Data)*, Inpaint-CropAndStitch (lquesada)*, InvSR (yuvraj108c), KJNodes (Kijai)*, kokoro (Stav Sapir), LayerStyle (chflame163)*, LayerStyle_Advance (chflame163), LG_Relight (laogou666), Manager (Dr.Lt.Data)*, Memory Cleanup (LAOGOU-666)*, MultiGPU (pollockjj)*, Patches_ll (lldacing), PC-ding-dong (lgldl), PuLID_Flux_ll (lldacing), Redux Advanced (yichengup)*, rgthree-comfy (rgthree)*, RMBG (AILab), Sonic (smthemex), SSStereoscope (SamSeen), SUPIR (Kijai), Thera (yuvraj108c)*, UltimateSDUpscale (ssit), utils-nodes (zhangp365), Various ComfyUI Nodes (jamesWalker55)*, VideoHelperSuite (Kosinkadink), wanBlockswap (orssorbit), WanVideoWrapper (kijai), WAS Node Suite (WASasquatch), WD14-Tagger (pythongosssss), and ZenID (Vuong Minh). Additional recommended add-ons are: LoRA manager (willmiao), Model-Manager (hayden-fr), and PNG Info Sidebar (KLL535). [* = lite edition] [π§ = experimental]
Recommended upscalers/refiners include 1xSkinContrast-SuperUltraCompact, Swin2SR, and/or 4xPurePhoto-RealPLSKR, or browse the OpenModelDB.
Accessory models (e.g., Florence 2) should download automatically when first run; so just be aware of any delays and check the terminal window to monitor progress.
Navigation & Recipes [Flux]
The workflow is structured for flexibility. With just a few adjustments, it can flip from text-to-image to image-to-image to inpainting or application of Flux Tools π οΈ. Additional unlinked nodes have been included to provide options and ideas for even more adjustments, such as linking in nodes for increasing details. (The workflow does not employ Anything Everywhere, so if a node connection looks empty, it really is empty.)
In the Switchboard, flip the yes|no π΅ toggles to activate or deactivate groups and the jump arrows β‘οΈ to quickly move to particular groups for checking and making adjustments to the settings/switches.
π DO NOT RUN THE WORKFLOW WITH ALL SWITCHES FLIPPED TO "YES"! π
There are also bookmarks π to help you navigate quickly.
In the rgthree settings, it is also recommended to show fast toggles in group headers for muting.
In the Lite Graph section of the settings, enable the fast-zoom shortcut and set the zoom speed to around 1.5β1.75. The workflow was built with a snap to grid size of 20.
Most of the workflow is unpinned π, so grab any empty space with your mouse (while pressing the control key) to navigate around. You are welcome to pin π anything to prevent accidentally moving groups or nodes.
Text-to-Image
This is the default recipe π₯£ and should be run first to make sure you have the basics configured correctly.
πͺ :: Toggle to "yes" 01a; 02b; 03 all; 04; and 05
03a :: Latent switch = 1 (empty)
03b :: Conditioning switch = 1 (no ControlNets +)
03e :: Denoise = 1; Guidance = 1.2β5; Steps 20β30, or 8β12 w/ Turbo LoRA
05 :: Image switch = 2 (save generated image)
Additional Recipes
Reference the Start Here group to find additional workflow recipes π₯£. For convenience, the package includes several PNG images πΌοΈ with embedded workflows.