Stable Video 3D (SV3D)

Stable Video 3D (SV3D) is a generative model based on Stable Video Diffusion that takes in a still image of an object as a conditioning frame, and generates an orbital video of that object.

This model was trained to generate 21 frames at resolution 576x576 given a context frame of the same size, finetuned from SVD Image-to-Video. Please check our tech report and video summary for details.

We release two variants of the model:

1. SV3D_u: This variant generates orbital videos based on single image inputs without camera conditioning.

2. SV3D_p: Extending the capability of SVD3_u, this variant accommodates both single images and orbital views allowing for the creation of 3D video along specified camera paths.

Model Sources

• Repository: https://github.com/Stability-AI/generative-models

• Tech report: https://stability.ai/s/SV3D_report.pdf

• Video summary: https://youtu.be/Zqw4-1LcfWg

• Project page: https://sv3d.github.io

• arXiv page: https://arxiv.org/abs/2403.12008

• Developed by: Stability AI

• Model type: Generative image-to-video model

• License: Stability AI Community License.

• Commercial License: to use this model commercially, please refer to https://stability.ai/license