This workflow lets you use ControlNet with Wan2.1 for text-to-image (T2I), just like we used to back in the SD1.5 and SDXL days. It's easy to install and use.
Sure, you could use reference images and videos for reference-to-video (R2V) generation, but that's a real pain for me to run, so it's not my focus.
For those who don't know about or haven't tried Wan2.1_Vace yet, it's time to jump on it and give this workflow a shot.
It's based on a workflow template from ComfyUI (so Sweet of them!), which I tweaked to fit my preferences and make it easier for my daily use.
Checkpoint:
/models/diffusion_models
https://huggingface.co/QuantStack/Wan2.1_14B_VACE-GGUF/tree/main
StepDistill Lora:
https://huggingface.co/lightx2v/Wan2.1-I2V-14B-480P-StepDistill-CfgDistill-Lightx2v/tree/main/loras