irAsu

irAsu is a second-stage finetune of Illustrious XL 0.1, which fixes the coloring, anatomy, and background of the images generated by the model.

Multistage finetuning is a system implemented and popularized by Animagine XL series to fix broken Unet. This method is proven to fix coloring, anatomy, background, and detail on the generated image.

Standard Prompting Guidelines

The model is finetuned from Illustrious XL v0.1, which is trained with danbooru tags. However, there is a little bit changes on dataset captioning, therefore there is some different default prompt used:

• Default prompt: 1girl/1boy, character name, from what series, everything else in any order, best quality, amazing quality, very aesthetic.

• Note: The quality tag masterpiece has been replaced with best quality due to reports that it often caused unwanted side effects.

• Default negative prompt: lowres, (bad), text, error, fewer, extra, missing, worst quality, jpeg artifacts, low quality, watermark, unfinished, displeasing, oldest, early, chromatic aberration, signature, extra digits, artistic error, username, scan, [abstract],

• Default configuration: Euler a with around 25-30 steps, CFG 3.5-5, and ENSD set to 31337. Sweet spot is around 28 steps and CFG 4.

Training Configurations

Finetuned from: Illustrious XL v0.1

Pretraining: N/A

Finetuning:

• Dataset size: 3,140 images

• GPU: 1xA100 80GB

• Optimizer: AdaFactor

• Unet Learning Rate: 3e-6

• Text Encoder Learning Rate: - (Train TE set to False)

• Batch Size: 16

• Gradient Accumulation: 3

• Warmup steps: 5%

• Min SNR: 5

• Epoch: 15

• Noise Offset: 0.0357

• Random Cropping: True

• Loss: Huber

• Huber Schedule: SNR

• Huber C: 0.1

License

irAsu falls under the Fair AI Public License 1.0-SD license.