Sign In

Zeroscope V2 576w (txt2video)

188
1.0k
5
Updated: Sep 13, 2023
tooltxt2video
Verified:
PickleTensor
Type
Other
Stats
1,012
Reviews
Published
Jun 24, 2023
Base Model
SD 1.5
Hash
AutoV2
E6040B6383
Moderator Badge
theally's Avatar
theally

Stop! These models are not for txt2img inference!

Don't put them in your stable-diffusion-webui/models directory and expect to make images!

So what are these?

These are new Modelscope based models for txt2video, optimized to produce 16:9 video compositions. They've been trained on 9,923 video clips and 29,769 tagged frames at 24 fps, 576x320 res.

Note that they can look much better - I had to convert the mp4 outputs to gif for Civitai. We can also upscale these videos using the Zeroscope v2 XL txt2vid models, which I'm currently uploading!

Note: this model is the lighter version of the XL model (available here) which requires a lot more VRAM. If you have >15GB of VRAM, you should be using the XL version.

Where do they go?

Drop them in the \stable-diffusion-webui\models\ModelScope\t2v folder

It's imperative you rename the text2video_pytorch_model.pt to .pth extension after downloading.

The files must be named open_clip_pytorch_model.bin, and text2video_pytorch_model.pth

Who made them? Original Source?

https://huggingface.co/cerspense/zeroscope_v2_576w

What else do I need?

These models are specifically for use with the txt2video Auto1111 WebUI Extension