Sign In

A Simple vid2vid AnimateDiff ComfyUI workflow

242

6.4k

138

Updated: Mar 13, 2024

Type

Workflows

Stats

5,916

0

Reviews

Published

Feb 20, 2024

Base Model

SD 1.5

Hash

AutoV2
66E3A39C52
AlexLai's Avatar

AlexLai

Since someone asked me how to generate a video, I shared my comfyui workflow. Compared to the workflows of other authors, this is a very concise workflow.

It must be admitted that adjusting the parameters of the workflow for generating videos is a time-consuming task,especially for someone like me with low hardware configuration. If I got better parameter, I would be happy to share it with everyone.

Release Note:

V2.0 : Adjusted parameters, workflow remains unchanged

Features:

  • ComfyUI workflow (not Stable Diffusion,you need to install ComfyUI first)

  • SD 1.5 model (SDXL should be possible, but I don't recommend it because the video generation speed is very slow)

  • LCM (Improve video generation speed,5 step a frame default,generating a 10 second video takes about 700s by 3060 laptop)

How to use:

  • You can change the model and prompt text,just like generating images .There are three parameters that need to be noted:

  • ImpactInt & batch_size & frame_rate : This is a set of interrelated parameters, frame_rate is your video frame rate, which is 30 by default. ImpactInt&batch_size is the total frame count your input video. If the frame rate is 30 and the duration is 10 seconds, then these two parameters should be 30 * 10=300

  • The LCM Lora : LCM-LoRA Weights - Stable Diffusion Acceleration Module - LCM for SDXL | Stable Diffusion LoRA | Civitai