Sign In

How to use Prompt Travel with Animatediff (Tutorial)

How to use Prompt Travel with Animatediff (Tutorial)


Animatediff was well known as animation extension for sd, but it can not control the animation sequence itself (like character's pose). then a new sub-extension appeared, "Prompt Travel". It serves as scheduled prompt function. allow you to use different prompt at different time and automatically add transition effect between them.

here's a complicated example:

How to Install:

Prompt Travel is a sub-extension of animatediff, so you need to install animatediff first

and then search "Prompt Travel" in Extensions and install it

ComfyUI user install "AnimateDiff Evolved" first, then install "FizzNodes" in comfyUI manager

How to use:

to use prompt travel is very simple, just write it in following format in Prompt

frame number1: the content A you want

frame number2: the content B you want

then it will let your animation change from A to B, between frame1~frame2

an example:

0: a nude girl

20: a cyborg girl

This is the thing I first want, then I extend it , and written the following:

RAW photo, best quality, masterpiece, in a ruined (futuristic:1.3) city,

0: a (nude:1.3) girl, (naked boobs:1.3), (detailed eyes:1.2)

20: a (cyborg:1.3) girl in (silver painted exoskeleton), (bodysuit:1.2), (mecha), (wearing a futuristic looking virtual reality headset goggles:1.2)

Then turn on AnimateDiff, set "Number of frames" to 30, Generate

She will change from nude to cyborg between 0~20, and keep cyborg at 20~30

Actually I shift to ComfyUI now, and use FizzNodes which similar to prompt travel with animatediff. Although vid2vid are very popular in civitai, the video resources are limited. Once you grasp txt2vid tricks, you'll have unlimited resoures and no need to search online videos anymore

more Complicated Tutorial:

Download ComfyUI Source File