LumaLabs: Luma Dream Machine Img2Vid Tutorial

Hey!
I'm still learning how to use Luma Dream Machine but I wanted to share what I've learned.

Let me know if you have questions so I can improve this tutorial.

https://lumalabs.ai/dream-machine/creations

TLDR: Use simple prompts. Do not turn on "Loop" or "Enhance Prompt"

• Basically this workflow is extremely simple but has very inconsistent results.

• I'm sure its possible to use complex prompts to get amazing animations but I've found that simple prompts produce the best results.

• I'm using Free-Tier and its extremely slow. I usually queue an animation and then checkback after 12+ hours.

Examples

Do not turn on "Enhance Prompt" this ruins simple animations.

"Loop" often causes the animations to be weird.

Melony

Prompt: live2d idle motion

Starting Image: https://civitai.com/images/27104909

Output Animation: https://civitai.com/images/27104696

Wendy

Prompt: live 2d idle animation, heart, cute, smug,

Starting Image: https://civitai.com/images/28214590

Output Animation: https://civitai.com/images/26401897

Coral/Sango

Prompt: smiling girl poses confidently, live2d idle animation

Starting Image: https://civitai.com/images/27116903

Output Animation: https://civitai.com/images/27116489

Complex Examples

Elesa

Prompt: beautiful girl smiles at you, eiffel tower and beautiful night sky in background

Starting Image: https://civitai.com/images/26498233

Output Animation: https://civitai.com/images/26497356

Raichu

Prompt: A cute, fuzzy yellow creature with big, expressive eyes and a cheerful smile holds out a steaming cup of coffee. The creature's soft fur appears inviting, and it stands with a friendly posture, extending the coffee cup towards you. The coffee inside the cup is gently emitting a wisp of steam, adding a cozy touch to the scene. The creature's warm, inviting gaze and the delicate steam from the coffee create a heartwarming and friendly atmosphere.

Starting Image: https://civitai.com/images/14641759

Output Animation: https://civitai.com/images/26400446