SingularUnity - Wan2.1 Ghibli Style T2V

April 01, 2025 Update.

Additional training and more test runs are to be completed. After this I give up; it's been my experience that AI video models aren't built for anime, and it's very difficult to capture the specific artistic and stylistic elements that make up this iconic anime. Just kidding.

March 31, 2025 Update.

Reclassified this model as a tool as I suspect it would be most useful in animating Ghibli style images; additionally, it is a LoRa trained to assist in the emulation of Ghibli distinct aesthetic and motion language. Additional training and fine-tuning will confirm this once completed. Stay tuned and stay blessed.

This is just another experimental LoRa as I refine and learn. I am proud to introduce a custom-trained LoRA adapter for the Wan2.1 Text-to-Video (T2V) 14B model, developed to emulate the distinct aesthetic and motion language of Studio Ghibli-style animation. This LoRA captures not just the visual appearance but the expressive character motion, natural environmental flow, and warmth that define Ghibli’s timeless style.

Additional updates and improvements to follow.

I2V Image Selection Guide:

So far I have only tested this model with the T2V though it should work with I2V just make sure the original image is in the same style as the iconic Studio Ghibli. More testing to follow.

Prompting:

These can be used directly or mixed as needed to trigger the LoRa effectively. It's important that you are detailed in your prompting. Try mixing them together and trying different seeds.

1. "Studio Ghibli anime style, watercolor-inspired backgrounds, soft line art, expressive characters, natural lighting, hand-drawn aesthetic"

2. "Lush and tranquil anime scene, vibrant soft color palette, traditional animation look, gentle shadows, Studio Ghibli atmosphere"

3. "Ghibli-style characters with expressive faces and fine clothing textures, smooth animation, naturalistic light, dreamy environment"

4. "Underwater anime scene in Ghibli style, ethereal lighting, flowing movements, whimsical designs, watercolor textures"

5. "Warm and nostalgic Studio Ghibli scene, traditional 2D animation style, natural world focus, subtle expressions, serene setting"

Example Prompt:

In this iconic Studio Ghibli-style anime scene, the vibrant underwater setting is captured with lush, vivid watercolor-inspired backgrounds that exude a sense of wonder and tranquility. Naturalistic lighting bathes the scene in a soft, ethereal glow, highlighting the intricate details of the characters' expressive faces and subtle expressions. The characters are depicted with expressive yet subtly detailed character designs, featuring exaggerated features like large eyes and long noses, which add to the whimsical charm of the scene. The animation is smooth and fluid, with a hand-drawn, traditional aesthetic that emphasizes gentle, harmonious colors and meticulous attention to natural details such as the texture of the characters' clothing and the movement of the water around them. This visual tone perfectly encapsulates the magical and serene atmosphere typical of Studio Ghibli animations.