Recipe:
In each step, TE weights were frozen - this model modifies only the unet. Machine captioned images were used until the last step.
Retrained SDXL 1.0 on 1.3M images for eight epochs
bs=80, lr=1e-05, optimizer=AdamW8Bit, EMA=0.95
Finetuned on 50k images for ten epochs to help do some rebalancing
bs=80, lr=2e-06, optimizer=AdamW8Bit, EMA=0.95
Aesthetic training on 30k images for 14 epochs
bs=1, lr=1e-05, optimizer=Adafactor, no EMA
Final alignment using 600 hand-selected and captioned images
bs=1, lr=1e-05, optimizer=Adafactor, EMA=0.95
Feel free to make your own merges and finetunes based on this checkpoint for non-commercial purposes. I ask that, if you do, you include a recipe with a similar level of detail as what I provided above. There's too much secrecy around this topic.
I have made checkpoints from step 2 & 3 in the recipe above available. These are not recommended for general use - they do not make good images out of the box. They may be useful for model mergers and finetuners.
","name":"Anteros XXXL","author":"erotes_anteros","datePublished":"2024-05-01T18:30:04.176Z","aggregateRating":{"@type":"AggregateRating","ratingValue":0,"reviewCount":0}}