DP's - Vid2Vid AniamteDiff LCM dance transfer

Support me for update

2024/9/22

Rewrote the edge detection function

and removed the #include "lygia/space/ratio.glsl" line

2024/9/4

update v1.4, automatic edge detection and replacement

2024/8/11

update v1.3. add SDXL upscale and more stable replace bg

2024/7/29

Simple Auto Mask For Videos @SouthbayJa

2024/7/14

update v1.2. Dance References

2024/7/12

For new comfyUI users, check your input model, like Lora. checkpoint, controlnet, aniamtediff, and upscale model, and don't forget to update your comfyUI all. There is a screenshot of the node in the download file for reference.

2024/7/9
Don’t let my reference examples stop you from exploring. In fact, any object can dance, such as water, rocks, clothes, cars, particles, etc.

2024/7/8
Updated download file-1.3, add ColorMod node, modified AnimateDiff node, and added a reference image

2024/7/7

I created a flower collection that might be helpful to you.

I used AE to cut out the character dance and turn it into a black and white mask. If you need skills in this area, just ask ChatGPT. He will teach you how to use AE to turn a video into a black and white mask. This is what I did.

Tips below from:https://civitai.com/models/372584/ipivs-morph-img2vid-animatediff-lcm-hyper-sd

❗If you are getting an error message CLIP Vision Model not found: /ComfyUI/models/clip_vision folder

• CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors download and rename

• CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors download and rename

❗If you are getting an error message IPAdapter model not found:

You are likely missing the IPAdapter model. In ComfyUI Manager Menu click Install Models - Search for ip-adapter_sd15_vit-G.safetensors and click Install.

If installing through Manager doesn't work for some reason you can download the model from Huggingface and drop it into \ComfyUI\models\ipadapter folder.

2024/7/6

Use QRCode Controlnet to control appearance and action, use IPAdapter to control the content and style of conversion.