Sign In

Controlnet v3 simple workflow FLUX | UPSCALE | LORA | GGUF | CIVITAI Metadata

83
2.1k
44
Updated: Dec 31, 2024
toolcontrolnetcomfyuicomfyv3flux.1
Type
Workflows
Stats
316
Reviews
Published
Dec 31, 2024
Base Model
Flux.1 D
Hash
AutoV2
33EC77E44F
New Years 2025 Badge
UmeAiRT's Avatar
UmeAiRT
The FLUX.1 [dev] Model is licensed by Black Forest Labs. Inc. under the FLUX.1 [dev] Non-Commercial License. Copyright Black Forest Labs. Inc.
IN NO EVENT SHALL BLACK FOREST LABS, INC. BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH USE OF THIS MODEL.

UmeAiRT controlnet v3 simple workflow

I share my controlnet workflow.

The easiest way to install all the files needed for workflow use is to use one of my installation scripts or my manager.
In general, you're missing the “RV-Tools” node, which is not detected by ComfyUI manager. You can find it in “Custom node manager”.

To install the missing nodes, I created a script : ComfyUI missing nodes auto installer - v2.0 | Flux Other | Civitai

I've written a complete guide to its use : Step-by-Step Guide Series: ComfyUI - ControlNet | Civitai

Resources you need:

Flux.1

Kijai/flux-fp8 at main (huggingface.co)
"flux1-dev-fp8" in ComfyUI\models\unet

black-forest-labs/FLUX.1-dev at main (huggingface.co)
"ae" in \ComfyUI\models\vae

comfyanonymous/flux_text_encoders at main (huggingface.co)
"t5xxl_fp8_e4m3fn" in \ComfyUI\models\clip
"clip_l" in \ComfyUI\models\clip

For GGUF

I recommend :
24 gb Vram: Q8_0 + T5_Q8 or FP8
16 gb Vram: Q5_K_S + T5_Q5_K_M or T5_Q3_K_L
<12 gb Vram: Q4_K_S + T5_Q3_K_L

GGUF_Model
city96/FLUX.1-dev-gguf at main (huggingface.co)
"flux1-dev-Q8_0.gguf" in ComfyUI\models\unet

GGUF_clip
city96/t5-v1_1-xxl-encoder-gguf at main (huggingface.co)
"t5-v1_1-xxl-encoder-Q8_0.gguf" in \ComfyUI\models\clip

Better flux text encoder
ViT-L-14-TEXT-detail-improved-hiT-GmP-TE-only-HF.safetensors · zer0int/CLIP-GmP-ViT-L-14 at main (huggingface.co)
"ViT-L-14-GmP-ft-TE-only-HF-format.safetensors" in \ComfyUI\models\clip

Upscaler

ESRGAN/4x_NMKD-Siax_200k.pth · uwg/upscaler at main (huggingface.co)
"4x_NMKD-Siax_200k.pth" in \ComfyUI\models\upscale_models

Controlnet

Canny: flux-canny-controlnet-v3.safetensors

https://huggingface.co/XLabs-AI/flux-controlnet-canny-v3/blob/main/flux-canny-controlnet-v3.safetensors

Depth: flux-depth-controlnet-v3.safetensors

https://huggingface.co/XLabs-AI/flux-controlnet-depth-v3/blob/main/flux-depth-controlnet-v3.safetensors

Hed: flux-hed-controlnet-v3.safetensors

https://huggingface.co/XLabs-AI/flux-controlnet-hed-v3/blob/main/flux-hed-controlnet-v3.safetensors

in \ComfyUI\models\xlabs\controlnets