santa hat
deerdeer nosedeer glow
Sign In

How I make animation via AnimateDiff (Tutorial)

68

Introduction

Animatediff was well known as animation extension for Stable Diffusion

whether you use Automatic1111 or comfyUI, it can work well with

here's an example: https://civitai.com/images/3662711

How to install:

search "AnimateDiff" in extension, and install it

download "mm_sd_v14.ckpt" and "mm_sd_v15_v2.ckpt" (click the arrow)

move downloaded files to "StableDiffusion Direcotry\extensions\sd-webui-animatediff\model"

close and restart "webui-user" then we can see AnimateDiff panel


ComfyUI user can use ComfyUI Manager to install "AnimateDiff Evolved" and "VideoHelperSuite"

download "mm_sd_v14.ckpt" and "mm_sd_v15_v2.ckpt" (click the arrow)

move downloaded files to "ComfyUI Direcotry\custom_nodes\ComfyUI-AnimateDiff-Evolved\models"

close and restart comfyUI, workflow in attchments

How to use:

The simplest way to make an animation is

  1. write prompt as generating image, set width, height to 512

  2. select one motion module (select mm_sd_v15_v2)

  3. turn on Enable AnimateDiff and MP4

  4. set Number of frames to 32, FPS to 16 and click Generate button :)

After finish you can find MP4 file at StableDiffusion\outputs\txt2img-images\AnimateDiff

( ComfyUI User:ComfyUI AnimateDiff Workflow )

Parameters Setting:

Wanna set more accurately, the following are the parameters I generally set
----------------------------------------------------------------------------------------

"Number of frames":Animation length, I set to 30

"FPS":Frames Per Second, play speed, I set to 30 (or lower)

then generate 30/30=1 second animation

----------------------------------------------------------------------------------------

Extend Animation Length: (optional)

Since 1 second animation is Not enough, need to extend it
we require to install ”Deforum(for extend animation length)

search "Deforum" in extension and install "deforum-for-automatic1111-webui"

close and restart webui-user, then we can go on
----------------------------------------------------------------------------------------

”Frame Interpolation“: SlowDown Switch, set to "FILM" (turn on)

only after install deforum, this can work

”Interp X“:SlowDown Multiplier, set to 10

then slow down 10 times, get 30/30x10=10 seconds animation

Then the animation is Long enough


other options can use default

A Beginner Can End Here


Troubleshooting:

1. If the animation changed in the middle, then go to "Setting" panel, check on "Pad prompt/negative prompt to be same length" option in "Optimizations"

2. AnimateDiff is conflict with ADetailer, if you have to use adetailer, you need to close and restart webui-user.bat after once generation

3. Model "mm_sd_v15v2.ckpt" seems to exist issue, sometimes "mm_sd_v14.ckpt" can generate better result. there's stable version model which can reduce the animation's variety

4. Better generate less than 512x768 animation, otherwise errors will occur, it's model issue regardless of VRAM

Advanced Tutorial:

Wanna make a transition animation see:https://civitai.com/articles/2943/how-to-use-prompt-travel-with-animatediff-tutorial
.

68