Animatediff Image2video 24/32.../120.../200.../280../520..Frames Attnmask Action Rgbsparsectrl SD15
42
1.5k
41
Updated: Apr 18, 2024
characterDownload
1 variant available
图生视频,现在可以生成更高帧率,人物一致性更高的视频。
I2V can now generate videos with higher frame rates and higher consistency of characters.
视频放大显存消耗过大问题,依然无法解决。
The problem of excessive VRAM consumption during video upscale still cannot be solved.
Show more

550 1 2 3 4 5 6 7 8 90 1 2 3 4 5 6 7 8 9
1000 1 2 3 4 5 6 7 8 90 1 2 3 4 5 6 7 8 90 1 2 3 4 5 6 7 8 9
Character precise motion control (test), improved on the basis of Animatediff SparseCtrl img2img2vid 4/8frames2VideoPrediction LLM SD15, adding key frame motion control, attention mask, combining SparseCtrl with the latest version of Ip-adapter-plus plus ip_plus_composition_sd15, which can be used for single img generates 16/24/32 frame video. The lower the frame rate, the more stable it is. The higher the frame rate, the greater the range of motion.
Frontal, side, clear posture , and img with a larger proportion of faces have better results.
PS: There is still a problem with video upscale. It consumes a lot of video memory and runs slowly, so it is temporarily unavailable.
人物精准动作控制(测试),在Animatediff SparseCtrl img2img2vid 4/8frames2VideoPrediction LLM SD15基础上改进,增加了关键帧动作控制,注意力遮罩,将SparseCtrl与最新版Ip-adapter-plus加ip_plus_composition_sd15结合,可以单张图生成16/24/32帧视频,帧率越低越稳定,帧率越高动作幅度越大。
正面,侧面,人脸占比较大的图,效果较好。
PS:视频放大还有问题, 消耗大量显存运行缓慢,暂时不能用。