A Spark's Odyssey

Initial Concept of the Project

This is a story about the birth of a spark of light and its journey to becoming a sun. The light goes through stages of growth, overcomes challenges, and finds its place in the world.

Key Stages

The light emerges as a spark, moves through the mist, and begins to become self-aware.

The light explores the world, alters its surroundings, and sees its reflection for the first time, realizing its own essence.

The light faces darkness and storms that test its resolve and strengthen its will.

The light rests on fields and hills, enjoying their beauty and calm. It observes the harmony of nature before ascending to the stars.

The light joins a stream of stars, becomes part of a galaxy, and establishes balance in the universe. In the end, it transforms into a new sun, bringing life to other worlds.

Workflow

The entire story (images, video, and speech) was generated using the Higgsfield.

Prompts were written within it for image generation, which were then refined when necessary with the built-in inpainting feature. The generated images were then used to create videos through the API of Kling 1.6, based on the text prompts (In several scenes, the initial frame for generating the video was taken from the final frame of the previous one). Next, within Higgsfield, the story was narrated using the built-in voice generation tool for the narrator character. The video clips were adjusted to match the audio length within Higgsfield.

Afterward, the generated video clips were used to create background sounds for the scenes using the MMAudio tool, based on video2video(the same video, but with added music) and text prompts. Then, through the Minimax Hailuo tool, music was generated to set the mood and atmosphere of the story (Both MMAudio V2 and MiniMax (Hailuo AI) Music were used via the Fal platform).

Finally, using the Recraft tool "frames"(Image2Image), the opening and closing frames were generated.

The audio, video, and final frames were combined in Kdenlive, where several transitions between scenes were also created to produce the final video.