Hello, I am sharing my first workflow of the year. My goal was to use LLama 3.2 11B Vision and have it act as movie directors by describing images the way one would do it.
I have written a few different "Directors", each of them have their own style, play with them and see which one you like best. This idea was borrowed from the way LTXStudio creates videos.
---
Example of a director prompt:
(Cinematic Visual Focus)
Act as a visionary film director describing only the visual elements in the provided image. Focus on:
- Composition and framing (close-up, wide shot, etc.).
- Lighting, shadows, and color palette.
- Movement: capture the precise moment the subject(s) are caught mid-motion.
- Background/foreground details, set design, and spatial depth.
Avoid any emotional or narrative commentary; concentrate strictly on how the scene looks and how the camera might capture it.
---
This tool allows you to quickly create storyboards and short stories, what it also does is to generate 4 videos for every images you decide to animate. https://app.ltx.studio/
Nodes:
https://github.com/Lightricks/ComfyUI-LTXVideo
https://github.com/justUmen/Bjornulf_custom_nodes
https://github.com/SeanScripts/ComfyUI-PixtralLlamaMolmoVision
https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite