Sign In

Animatediff Image2video 24/32.../120.../200.../280../520..Frames Attnmask Action Rgbsparsectrl SD15

39
1.1k
19
Updated: Apr 18, 2024
character
Type
Workflows
Stats
795
0
Reviews
Published
Apr 18, 2024
Base Model
SD 1.5
Usage Tips
Clip Skip: 1
Hash
AutoV2
799A592A77

Character precise motion control (test), improved on the basis of Animatediff SparseCtrl img2img2vid 4/8frames2VideoPrediction LLM SD15, adding key frame motion control, attention mask, combining SparseCtrl with the latest version of Ip-adapter-plus plus ip_plus_composition_sd15, which can be used for single img generates 16/24/32 frame video. The lower the frame rate, the more stable it is. The higher the frame rate, the greater the range of motion.

Frontal, side, clear posture , and img with a larger proportion of faces have better results.

PS: There is still a problem with video upscale. It consumes a lot of video memory and runs slowly, so it is temporarily unavailable.

人物精准动作控制(测试),在Animatediff SparseCtrl img2img2vid 4/8frames2VideoPrediction LLM SD15基础上改进,增加了关键帧动作控制,注意力遮罩,将SparseCtrl与最新版Ip-adapter-plus加ip_plus_composition_sd15结合,可以单张图生成16/24/32帧视频,帧率越低越稳定,帧率越高动作幅度越大。


正面,侧面,人脸占比较大的图,效果较好。

PS:视频放大还有问题, 消耗大量显存运行缓慢,暂时不能用。