Sign In

BlueAilandMix

516
3.9k
24
Verified:
SafeTensor
Type
Checkpoint Merge
Stats
1,021
Reviews
Published
Jan 8, 2024
Base Model
SD 1.5
Usage Tips
Clip Skip: 2
Hash
AutoV2
1B412B364E

Uploaded by request. Made in an attempt to have an anime-style shading closer to the cel-shading/flat color artstyle with softer lighting and colors. I don't understand how model-merging works so I am not able to fix any problems that arise.

2.0 Changes:

  • Added brighter anime models: MistoonDiamond and LiveAnime_flat to get slightly more vivid colors

  • Adjusted color tones to reduce purple tinting effect

Issues:

  • Difficult to generate male characters. Still possible but requires a lot of finessing

  • Purple tinting still remains; As a bit of side effect, there are some weird color choice towards red and green occasionally

  • Hands are bad

  • Proportions are occasionally wonky towards more nsfw things (not really my priority)

Things to try and work on:

  • Try to consistently eliminate hair highlights similarly to Blue Archive hairstyle

  • Reduce gradient/bending effect

Uploaded as a 2.0 update rather than 1.2 since there were some significant changes in a couple of prompts so I wouldn't pend it as a minor change. A general reminder that I have no idea what I am doing.

Noted Changes from 1.0:

  • Less illustrative shadows

  • flatter hair color

  • lighter coloring

  • lighter lines

Issues:

  • 1.1 has a stronger bias towards female characters so if you want to make male characters put more emphasis on male keywords, and avoid using terms that could cause conceptbleed

  • I highly recommend using OUTD with the LoRA block weight extension whenever you are using any kind of LoRA/Lycoris model. I found that are still some cases where the model is unstable with some LoRAs and will introduce a lot of artifacts to the image. You can probably use the mentioned extension to fix the issue. I'm not sure what causes it though.

Mixed several lycoris from Cel Shaded Artist Styles [Screencap, Official/Promo Styles] and Blue Archive Artstyle LoHA Model Released. Again, I have absolutely no idea what I am doing but I noticed that mixing the Lycoris models together did give a noticeable impact so I'm updating it as a 1.1 minor update. The demo images were made by upscaling using AnimeSharp4x and adetailer.

Recommended Settings

Sampler: Euler or DPM++ 2M Karras

Steps: 20

CFG: 7

VAE: ClearVAE or any anime based VAE works fine.

Highres fix: Recommended but is still possible to get good quality at lower resolution

CLIP skip : 2

Face Restoraton: Disabled. Make sure that Face restoration is not enabled otherwise you'll get realistic lips.

Upscaler: AnimeSharp4x is what I normally use. I don't recommend using the latent upscaler.

Upscale Denoise: 0.5 with AnimeSharp4x. Denoising strength varies for each upscaler.

Negative Embeddings: EasyNegative, EasyNegativeV2, AuroraNegative,KFHB, badhandv4, and verybadimagenegative seem to work fine. I haven't thoroughly tested what gives the best quality.

Tips

  1. Good quality can still be achieved at lower resolution but will require showing only limited portions of the body such as only the face view, or upperbody view.

  2. For fullbody poses, hi-res fix with 2x to 4x upscale is recommended to reduce chances of distortion. I recommend using the MultiDiffusion extension to help with producing large images

  3. For Character LoRas, I recommend using the LoRA Block Weight extension so the original artstyle from the LoRA does not heavily overwrite the model's artstyle. I normally use OUTD weight preset with my artworks but I found it's rather case by case for each LoRa and does not work all of the time. In those cases, you can try and use other style LoRAs such as the アニメ塗り Anime Style to help emphasize the coloring effect.

  4. The flat color seems to be more affected by negative keywords such as ((worst quality:1.4,low_quality)) so adjust the weights as needed

Model Issues:

  1. Eyes will get distorted

  2. Hands

  3. Multiple img2img passes causes final image to have a more purplish tint

  4. Bias to younger looking characters

Issues 1 can be fixed with inpainting. Hands will mostly be luck, editing, ControlNet, and inpainting.

Issue 3 can be somewhat fixed by using ControlNet LineArt with 1.4 or higher weight and image denoise 0.7. Try using canny instead if you want to keep the background intact. I can't test multi-controlnet with (tile,color-adapter,and line-art) due to vram issues.

Issue 4 might be solvable by adding words like loli, and loliface to the negative prompt with or without emaphasis.

Recipe

This is a rather straightforward mix of AniMix,AniReality, and BlueMix

  1. AutoMBW (AniMix, AniReality) -> AilandMix

  2. AilandMix + 0.5 Weighted Sum BlueMix -> BlueAilandMix

V1.1

Step 1.Lycoris Merged Model(Unreleased)

  1. BlueAilandMixv1 + Cel Shaded Artist Styles [Screencap, Official/Promo Styles] - Eufoniuz 0.6 = Model 1

  2. Model 1 + Cel Shaded Artist Styles [Screencap, Official/Promo Styles] Ishiseito 0.6 = Model 2

  3. Model 2 + Blue Archive Artstyle LoHA Model Released v1.0-6 0.4 = Lycoris Merged Model

Interestingly, this mix is rather unstable and I noticed that I lost about 2GB of data after merging. It tends have very oversaturated colors and doesn't play well with LoRAs. Interestingly after mixing it with some models, it began to stabilize.

Step 2.Triple Sum Merge(BlueMix,Ailand)

  1. Models: BlueMix2.5a,Lycoris Merged Model, AilandMix

  2. Merge Weight: Alpha = 0.5; Beta = 0.5

End Result: BlueMix 0.25 + Lycoris Merged Model 0.5 + AilandMix 0.25 = v1.1

V2.0

Model A:

  1. MistoonDiamond

  2. Eufoniuz 0.4 OUTD

  3. Ishiseito 0.4 OUTD

  4. 碧蓝档案平涂风格/blue archive style Lora 0.6 OUTD

Model B:

  1. 11_blueailandMix

Model C:

  1. LiveAnimeMix_flat

The adjustment values probably aren't 100% correct as I don't remember exactly what I put.

First Mix: A+B+C Sum Twice (Alpha: 0.25 ; Beta:0.25) : Color Adjust: Bright: 1 R2.5 G2 Blue: 0.5

Second Mix: FirstMix + BlueMix: (Alpha 0.3): Color Adjust: Bright: 0 R:1 G3 Y:1

Random Notes: AilandMix,Anylora,AniMix produced colors that were too dark so there was need to rely on brighter colors. Color adjustment for red was somewhat needed since the Nilou color was producing orange colors instead of red.