Sign In

ipiv's Morph - img2vid AnimateDiff LCM / Hyper-SD

2.1k
26.9k
1.1k
Type
Workflows
Stats
16,639
Reviews
Published
Apr 26, 2024
Base Model
SD 1.5
Hash
AutoV2
85E41B617C
default creator card background decoration
ipiv

Workflow for generating morph style looping videos.

v3: Hyper-SD implementation - allows us to use AnimateDiff v3 Motion model with DPM and other samplers. Seems to result in improved quality, overall color and animation coherence.


Uses QRCode Controlnet to guide the animation flow, morphing between the reference images is done via IPAdapter attention masks.

Here are some more motion masks to use with QRCode - kindly provided by @Xenodimensional: https://civitai.com/posts/2011230

❗If you are getting an error message CLIP Vision Model not found: /ComfyUI/models/clip_vision folder

❗If you are getting an error message IPAdapter model not found:

You are likely missing the IPAdapter model. In ComfyUI Manager Menu click Install Models - Search for ip-adapter_sd15_vit-G.safetensors and click Install.

If installing through Manager doesn't work for some reason you can download the model from Huggingface and drop it into \ComfyUI\models\ipadapter folder.

ViT-G model is what I used in the workflow but I suggest you try out other IPAdapter models as well.