Type | Workflows |
Stats | 292 0 |
Reviews | (15) |
Published | Apr 13, 2025 |
Base Model | |
Hash | AutoV2 AC03D37649 |
V1.1 - Sorry for the quick release wanted to get this out before i was done for the day.
added batching (works but its not perfect)
added hand masks (sam 1 mask) Option to add lineart hands to control
added model upscale and frame interpolation.
added a few more notes.
added many missing switches
V1
Removed pony.
Start frame and control video. If you make a start frame it works well, if you dont you can still get good results
All examples dont use a custom start frame and just a cropped image ref.
Beta
- warning this works on 12gb. i dont know if it can do less. Pony takes A lot in itself. This has very few notes, and while its all grouped properly its a complex flow that has many moving parts. I am working on finishing this but wanted to see if there was any real interest before i did much more.
I used the 1.3b control model.
- multi step wan video to video with image ref.
-Depth and openpose controls
-full masking support with florence and sam 2
-full pony/xl groups for first frame image generations
-Teacache
-as low as 8 steps video renders
-2 upscale options
-bg replace
-lots of other things
https://huggingface.co/alibaba-pai/Wan2.1-Fun-1.3B-Control/tree/main
https://huggingface.co/alibaba-pai/Wan2.1-Fun-14B-Control/tree/main