Sign In

Inpainting for any model?

Inpainting for any model?

Did you know you can create an in-painting version for any model?

Here is what you can do.

Following this article by Stable Diffusion:

Grab the model that you want to use for in-painting.

Mine will be my latest upload.


Version 1.10

You will require 3 models in total.

  1. Default in-painting model for the Stable Diffusion model

  2. Your model

  3. Default version of the Stable Diffusion model

After you have all of these files you can then go to Automatic 1111 on the Checkpoint merger page. (I am not sure how this would work for other Image generation Frameworks)

What you have to then do:

  1. Set Primary to the default model

  2. CRUCIAL: Set Secondary to YOUR model

  3. Set Tertiary to the Inpainting version.

  4. Set the multiplier to 1

  5. Give your model a name and then select ADD DIFFERENCE (This will make sure to add only the parts of the inpainting model that will be required)

Select ckpt or safetensors. (safetensors are recommended)

And hit Merge.

This might take some time

And without me specifying the -inpainting at the back we get that automatically with the result.

File output: C3_V1.10.inpainting.safetensors

And for a quick test we can try out the model.

This is a quick result.

From this image.

I hope that you find this tutorial helpful.

Thank you for reading this far. And if you this type of content consider supporting me with the links in my profile bio.

Thank you.