Sign In

ProtogEmb 2 (for SD 2.x 768)

182
1.6k
3
Verified:
PickleTensor
Type
Embedding
Stats
1,591
Reviews
Published
Jan 19, 2023
Base Model
SD 2.1 768
Training
Steps: 4,000
Trigger Words
protogemb2
Hash
AutoV2
159DCB272A
default creator card background decoration
pgibbs's Avatar
pgibbs

Same idea as the original ProtogEmb but retrained from scratch on SD 2.1 768 version.

Since the training images were higher quality it can output much more detailed pictures, I also expanded the base images for training from 67 to 92, all generated using Protogen 2.2/3.4 by Darkstorm2150

HOW TO USE

just drop it into your "embeddings" folder and type the name of the file in your prompt, you can also rename it to whatever you want and use that as the trigger.

Unlike most of SD 2.x you don't need a ton of negative prompts for it to look nice, I personally like to add "cartoon, 3d" to the negatives as the results end up looking higher fidelity.

HOW WAS IT MADE?

The images used to train it were from Protogen 2.2 and 3.4 using the base prompt darkstorm2150 used for the showcase images of the original models.

For this updated embedding I started by training a base in 1500 steps, then further bursts of 100 steps switching the datasets to focus and enhance any part I felt was lacking.

SPECS

8 vectors per token, 4000 steps, 92 base images (which were switched around for focused training), batch size of 4, prompt template being either style_filewords or a custom one which I edited according to what was the focus of the training, shuffle tags enabled, learning rate from 0.005 for general training to 0.0001 to focused training.