ComfyUI AnimateDiff Workflow.json

<h1 id="heading-899">Introduction</h1>Animatediff was well known as animation extension for Stable Diffusionwhether you use Automatic1111 or comfyUI, it can work well withhere's an example: <a target="_blank" rel="ugc" href="https://civitai.com/images/3662711">https://civitai.com/images/3662711</a><h1 id="heading-103">How to install：</h1>search "AnimateDiff" in extension, and install it<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b9386c67-fbf7-4ae4-beac-eef39214eb9e/width=525/b9386c67-fbf7-4ae4-beac-eef39214eb9e.jpeg" />download <a target="_blank" rel="ugc" href="https://huggingface.co/guoyww/animatediff/tree/main">"mm_sd_v14.ckpt" and "mm_sd_v15_v2.ckpt" </a>(click the arrow)<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/43ace98c-b4e4-4c6c-ab17-ddd5a1b8f088/width=525/43ace98c-b4e4-4c6c-ab17-ddd5a1b8f088.jpeg" />move downloaded files to "StableDiffusion Direcotry\extensions\sd-webui-animatediff\model"close and restart "webui-user" then we can see AnimateDiff panel<hr /><h1 id="heading-900">How to use:</h1>The simplest way to make an animation is<ol><li>write prompt as generating image, set width, height to 512</li><li>select one motion module (select mm_sd_v15_v2)</li><li>turn on Enable AnimateDiff and MP4</li><li>set Number of frames to 32, FPS to 16 and click Generate button ：)</li></ol><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/d32c97a3-581b-49ed-9221-40c9dcabeb4c/width=525/d32c97a3-581b-49ed-9221-40c9dcabeb4c.jpeg" />After finish you can find MP4 file at StableDiffusion\outputs\txt2img-images\AnimateDiff( ComfyUI User：<a target="_blank" rel="ugc" href="https://civitai.com/api/download/attachments/12103">ComfyUI AnimateDiff Workflow )</a><h1 id="heading-901">Parameters Setting:</h1>Wanna set more accurately, the following are the parameters I generally set ----------------------------------------------------------------------------------------"Number of frames"：Animation length, I set to 30"FPS"：Frames Per Second, play speed, I set to 30 (or lower)then generate 30/30=1 second animation----------------------------------------------------------------------------------------<h1 id="heading-902">Extend Animation Length: (optional)</h1>Since 1 second animation is Not enough, need to extend it we require to install ”Deforum“ (for extend animation length) <img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/27857170-59be-4d58-afea-9d1184f48dfe/width=525/27857170-59be-4d58-afea-9d1184f48dfe.jpeg" />search "Deforum" in extension and install "deforum-for-automatic1111-webui"close and restart webui-user, then we can go on ----------------------------------------------------------------------------------------<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/4457c793-13bf-40fe-860b-5e0c1d2b3a98/width=525/4457c793-13bf-40fe-860b-5e0c1d2b3a98.jpeg" />”Frame Interpolation“: SlowDown Switch, set to "FILM" (turn on)only after install deforum, this can work”Interp X“：SlowDown Multiplier, set to 10then slow down 10 times, get 30/30x10=10 seconds animationThen the animation is Long enough<hr />other options can use defaultA Beginner Can End Here<hr /><h1 id="heading-904">Troubleshooting：</h1>1. If the animation changed in the middle, then go to "Setting" panel, check on "Pad prompt/negative prompt to be same length" option in "Optimizations"<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/83243710-7dfe-4c10-8586-00f31746cac7/width=525/83243710-7dfe-4c10-8586-00f31746cac7.jpeg" />2. AnimateDiff is conflict with ADetailer, if you have to use adetailer, you need to close and restart webui-user.bat after once generation3. Model "mm_sd_v15v2.ckpt" seems to exist issue, sometimes "mm_sd_v14.ckpt" can generate better result. there's <a target="_blank" rel="ugc" href="https://huggingface.co/manshoety/AD_Stabilized_Motion/tree/main">stable version model</a> which can reduce the animation's variety4. Better generate less than 512x768 animation, otherwise errors will occur, it's model issue regardless of VRAM<h1 id="heading-903">Advanced Tutorial：</h1><h3 id="heading-3">Wanna make a transition animation see：<a target="_blank" rel="ugc" href="https://civitai.com/articles/2943/how-to-use-prompt-travel-with-animatediff-tutorial">https://civitai.com/articles/2943/how-to-use-prompt-travel-with-animatediff-tutorial</a> .</h3>