Zen Transformation (Wan2.1 I2V LoRA)

Request a Wan2.1 LoRA on our Discord and we will train and open-source it for free.

Join our Discord to generate videos of the Zen Transformation LoRA for free.

Wan2.1 14B I2V 480p v1.0:

Trained on 35 seconds of video comprised of 7 short clips (each clip captioned separately) of people undergoing a zen transformation. This was trained on the Wan.21 14B I2V 480p model.

The trigger word is: 'z3n1fy zen transformation'

See below for some prompt examples that worked well for me. You can also check the videos I've posted here for the captions that were used to generate them. For each video the input image is just the first frame.

Recommended Settings:

LoRA strength = 1.0

Embedded guidance scale = 6.0

Flow shift = 5.0

Here's a link to the Wan2.1 I2V LoRA inference workflow I used to generate these videos: https://huggingface.co/Remade/Squish/blob/main/workflow/wan_img2video_lora_workflow.json

This is a slight modification to Kijai's version, with the main difference being the addition of the WanVideo Lora Select node, connected to the 'lora' field of the WanVideo Lora Select node. Find Kijai's original workflow here:
https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo_480p_I2V_example_02.json

Check out all our LoRAs on our page: https://app.remade.ai/

Prompt Examples:

The video starts with Pepe the Frog looking sad in a blue shirt, then undergoes a z3n1fy zen transformation, now wearing a black kimono with white floral designs and a white collar, walking towards the camera holding a fan and basket. The background has transformed into a serene Japanese garden.

The video begins with Goku's face with the energy field background, then z3n1fy zen transformation. He is wearing a traditional Japanese garment, holding a fan and woven basket, standing in a Japanese garden.

The video starts with a portrait of a rodent. The scene then transitions to the rodent's z3n1fy zen transformation as the rodent is wearing a pink robe with a white shirt underneath, with a zen garden background. The rodent is facing the camera with a neutral expression. The background appears to be blurred and out of focus. The scene then transitions again to show the transformed rodent, in what appears to be a garden setting. The rodent is now wearing a black kimono with white floral designs and a white belt. The rodent carries a basket in one hand and a colorful fan in the other. The rodent is walking down a pathway lined with hedges and greenery. The z3n1fy zen transformation is complete. The rodent has a neutral expression, looking directly at the camera.

Let me know if there are any questions, I'll be happy to help!