LTXV - Animating images that typically don't yield good results

In this tutorial, we will learn how to animate images using LTXV, specifically those that initially do not yield good results.

The workflow used is a customized modification of the following workflow:

https://github.com/sandner-art/ai-research/blob/main/LTXV-Video/ltxvideo_I2V-motionfix.json

This approach was inspired by the idea of using blur effects to improve results, as proposed by VoidVisionary in:

https://civitai.com/models/1057138

The zip includes: The workflow, a .png image of the Mona Lisa without blur, a .png image of the Mona Lisa with blur and a .psd archive with the edition.

This workflow incorporates a modified version of the VAE created by SpacePXL, which you can find here:

https://huggingface.co/spacepxl/ltx-video-0.9-vae-finetune/tree/main

In this case, I am using ltx-video-v0.9-vae_finetune_all.safetensors, which you should place in the models/VAE folder of ComfyUI.

The model used for LTX is ltx-video-2b-v.0.9.1.safetensors, which should be placed in the models/checkpoints folder of ComfyUI:

https://huggingface.co/Lightricks/LTX-Video/tree/main

The text encoder used is t5-v1_1-xxl-encoder-Q6_K.gguf:

https://huggingface.co/city96/t5-v1_1-xxl-encoder-gguf/tree/main, which should be placed in the models/clip folder of ComfyUI.

This workflow utilizes the following custom nodes:

• https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite

• https://github.com/city96/ComfyUI-GGUF

• https://github.com/logtd/ComfyUI-LTXTricks

Once everything is set up, we will load the initial image of the Mona Lisa. If we use it as is (without blur) and render it, we will get a very limited animation. To enhance the animation, we will simply use a image editor, select the face, copy it, paste it onto another layer, and apply a slight horizontal motion blur. I’ve provided a Photoshop file where the face has been converted into a Smart Object with a horizontal motion blur of 12 applied. I also add the image of the Mona Lisa already blurred.

If we now copy and paste our modified image into ComfyUI, we will see a much smoother and more natural animation.

This technique can be applied to almost any image, and experimentation is encouraged.