santa hat
deerdeer nosedeer glow
Sign In

Jack Sparrow - Realistic + Anime - LoRA + Guide

563
2.7k
3.0k
15
Verified:
SafeTensor
Type
LoRA
Stats
2,738
2,959
Reviews
Published
Feb 23, 2023
Base Model
SD 1.5
Trigger Words
jack sparrow
Hash
AutoV2
9CA55CD263
default creator card background decoration
Lykon's Avatar
Lykon

Jack Sparrow - Realistic + Anime - LoRA

Making models can be expensive. Do you like what I do? Consider supporting me on Patreon 🅿️ or feel free to buy me a coffee

Consider leaving a ❤️ to receive future updates.

This is a successful experiment I made for testing out my theory on how to make an anime character from a photorealistic dataset. The answer was simply to use NeverEnding Dream (NED). NED was made basically to bridge the gap between photorealistic models and anime ones, so the theory was to use a dataset made of movie screencaps of Jack Sparrow (about 80), tag them with booru style tags (using a combination of WD Tagger + manual) and train a LoRA on NED.
If you then make the inference on NED it gives a perfectly photorealistic model, but if you use it on AnyLoRA or anime models in general it gives you an anime version of Jack Sparrow with little to no style transfer.

You can probably use this technique to turn any real person into an anime counterpart and vice versa (see: my Ganyu LoRA).

You can use at weight 1 generally, but tune it based on the model. Trigger is jack sparrow.

As most of my LoRA's, this can be customized a lot. In the examples I provided a blonde anime girl Jack Sparrow. Examples 6 and 7 are of course using my One Piece style LoRA. Third image by bloodsplash09.

How to use LoRA's in auto1111:

  • Update webui (use git pull like here or redownload it)

  • Copy the file to stable-diffusion-webui/models/lora

  • Select your LoRA like in this video

  • Make sure to change the weight according to the instructions (by default it's :1)