ghost
Sign In

Dreamshaper XL Lightning inpainting

167
5.1k
52
Updated: Apr 21, 2024
toolinpaintnsfwoutpaint
Verified:
SafeTensor
Type
Checkpoint Merge
Stats
5,112
Reviews
Published
Apr 16, 2024
Base Model
SDXL Lightning
Usage Tips
Clip Skip: 2
Hash
AutoV2
1A49CD4473
default creator card background decoration
WereCatf's Avatar
WereCatf

Introduction

This is an inpainting model of the excellent Dreamshaper XL model by @Lykon similar to the Juggernaut XL inpainting model I just published. People seem to really like both the Dreamshaper XL and lightning models in general because of their speed, so I figured at least some people might like an inpainting model as well.

The whole purpose of inpainting models is to provide at least somewhat better results when inpainting or outpainting an image. When e.g. outpainting an image, with the normal checkpoint models you tend to get a very visible seam between the original part of the image and the newly extended part -- this model helps eliminate that seam! Also, using a specific version of an inpainting model instead of the generic SDXL-one tends to get more thematically consistent results.

Here is an example of a rather visible seam after outpainting:

The original model on the left, the inpainting model on the right. (Yes, I cherrypicked one of the worst examples just to demonstrate the point)

Disclaimer: you definitely can get good results even without, but it's easier with an inpainting model. No need for any offensive comments about how I'm bad and should feel bad.

How to use:

Basically, the same general guidelines apply as for the original model, ie. DPM++ SDE Karras as the sampler and 3-8 steps, denoising strength 0.8 and CFG scale 2 for generally good results. I am still experimenting with lightning models and inpainting/outpainting as to how to get the best results within the least amount of time.

Other stuff:

Created in Automatic1111 by merging the base SDXL inpainting model (by wangqyqq), Dreamshaper XL Lightning DPM++ SDE, SDXL Lightning 8-step base and the fp16 fix VAE. As a complete newcomer to this whole AI image generation scene, I am not at all certain this is the correct way of making lightning inpaint models, but it seems to work fine in my own experiments.