Workflow patch notes:
ComfyUI - IMG to VIDEO Workflow 2.0
This article accompanies this workflow: link
Foreword :
English is not my mother tongue, so I apologize for any errors. Do not hesitate to send me messages if you find any.
This guide is intended to be as simple as possible, and certain terms will be simplified.
Workflow description :
The aim of this workflow is to generate video from an existing image in a simple window.
What's new? :
Added non-GGUF version and without nightly node,
New interface :
New upscaler :
ComfyUI Upscaler TensorRT replaces the native upscaler for a gain in speed and stability.
In addition, the models are automatically downloaded if they are not present.
New model optimisation :
Please note this requires VS tools and Triton to be used.
New LoRA loader :
More simple, easy and convenient.
New model loader to unload part to RAM:
You can easily choose how many GB you want to move to RAM and thus either use a larger model or gain stability at a very small loss in speed.
Known issue :
The new "Upscaler TensorRT" node sometimes does not install correctly.
You must therefore install a specific python module:
.\python.exe -s -m pip install wheel-stub
If you have already installed the node you can then install the prerequisites from the node folder:
..\..\..\python_embeded\python.exe -s -m pip install -r requirements.txt
Torch compile dont work :
You need Visual studio build tools and triton to use this.
For Visual studio build tools execute this on a CMD:
winget install --id Microsoft.VisualStudio.2022.BuildTools -e --source winget --override "--quiet --wait --norestart --add Microsoft.VisualStudio.Component.VC.Tools.x86.x64 --add Microsoft.VisualStudio.Component.Windows10SDK.20348"For triton in your python folder execute this command :
.\python.exe" -s -m pip install triton-windows==3.2.0.post17