Introduction
Animatediff was well known as animation extension for Stable Diffusion
whether you use Automatic1111 or comfyUI, it can work well with
here's an example: https://civitai.com/images/3662711
How to install：
search "AnimateDiff" in extension, and install it
download "mm_sd_v14.ckpt" and "mm_sd_v15_v2.ckpt" (click the arrow)
move downloaded files to "StableDiffusion Direcotry\extensions\sd-webui-animatediff\model"
close and restart "webui-user" then we can see AnimateDiff panel
ComfyUI user can use ComfyUI Manager to install "AnimateDiff Evolved" and "VideoHelperSuite"
download "mm_sd_v14.ckpt" and "mm_sd_v15_v2.ckpt" (click the arrow)
move downloaded files to "ComfyUI Direcotry\custom_nodes\ComfyUI-AnimateDiff-Evolved\models"
close and restart comfyUI, workflow in attchments
How to use:
The simplest way to make an animation is
write prompt as generating image, set width, height to 512
select one motion module (select mm_sd_v15_v2)
turn on Enable AnimateDiff and MP4
set Number of frames to 32, FPS to 16 and click Generate button ：)
After finish you can find MP4 file at StableDiffusion\outputs\txt2img-images\AnimateDiff
( ComfyUI User：ComfyUI AnimateDiff Workflow )
Parameters Setting:
Wanna set more accurately, the following are the parameters I generally set
----------------------------------------------------------------------------------------
"Number of frames"：Animation length, I set to 30
"FPS"：Frames Per Second, play speed, I set to 30 (or lower)
then generate 30/30=1 second animation
----------------------------------------------------------------------------------------
Extend Animation Length: (optional)
Since 1 second animation is Not enough, need to extend it
we require to install ”Deforum“ (for extend animation length)
search "Deforum" in extension and install "deforum-for-automatic1111-webui"
close and restart webui-user, then we can go on
----------------------------------------------------------------------------------------
”Frame Interpolation“: SlowDown Switch, set to "FILM" (turn on)
only after install deforum, this can work
”Interp X“：SlowDown Multiplier, set to 10
then slow down 10 times, get 30/30x10=10 seconds animation
Then the animation is Long enough
other options can use default
A Beginner Can End Here
Troubleshooting：
1. If the animation changed in the middle, then go to "Setting" panel, check on "Pad prompt/negative prompt to be same length" option in "Optimizations"
2. AnimateDiff is conflict with ADetailer, if you have to use adetailer, you need to close and restart webui-user.bat after once generation
3. Model "mm_sd_v15v2.ckpt" seems to exist issue, sometimes "mm_sd_v14.ckpt" can generate better result. there's stable version model which can reduce the animation's variety
4. Better generate less than 512x768 animation, otherwise errors will occur, it's model issue regardless of VRAM