Sign In

Simple Prompt Travelling with AnimateDiff and ComfyUI

11
Simple Prompt Travelling with AnimateDiff and ComfyUI

A simple workflow that allows to use AnimateDiff with Prompt Travelling. You will need the AnimateDiff-Evolved nodes, the motion modules and any stable diffusion v15 model.

I had the best results with the mm_sd_v14.ckpt AnimateDiff module, it makes the transition more clear. The longer the animation the better, even if it's time consuming. I would say to use at least 24 frames, 12 if it's just for testing.

The structure of the prompt is as follows:

"0": "blue background",

"8": "eyes of fire, orange background",

"16" :"face on (fire:1.4), red background",

"24" :"Made of flames, full fire"

Where each number corresponds to the position of the frame in the final animation; this means that AnimatedDiff will try to create transitions between each prompt.

You can read more about AnimateDiff and Prompt Travelling on this article.

11

Comments