santa hat
deerdeer nosedeer glow
Sign In

AAM - AnyLoRA Anime Mix - Anime Screencap Style Model

6.4k
63.4k
2.0m
952
Verified:
SafeTensor
Type
Checkpoint Trained
Stats
60,336
2,031,205
Reviews
Published
Jun 5, 2023
Base Model
SD 1.5
Hash
AutoV2
354B8C571D
default creator card background decoration
Lykon's Avatar
Lykon

AnyLoRA Anime Mix (AAM)

Anime Screencap Style Model

Do you like what I do? Consider supporting me on Patreon 🅿️ or feel free to buy me a coffee ☕.
A ❤️, a kind comment or a review is greatly appreciated.

Please check out AAM XL too

Purpose of this model

  • Make amazing anime style artworks on its own.

  • Train character loras where the dataset is mostly made of anime screencaps, allowing less anime style transfer and less overfitting.

  • Use anime styles if the lora is "weak" and doesn't give enough flat coloring.

  • It's also pretty good at generating hentai stuff.

Suggested settings

  • Set the ETA Noise Seed Delta (ENSD) to 31337

  • Set CLIP Skip to 2

  • DISABLE face restore. It's terrible, never use it

  • Use negative prompts and embeddings that don't ruin the style

  • Use AnimeVideo or Foolhardy as upscalers. If you know what to do, Latent makes an interesting effect (see the first example and the Miku one)

  • (optional to reproduce some results) Set "Do not make DPM++ SDE deterministic across different batch sizes." Only my old images use that.
    (this setting is not actually good, so I'm gonna disable it, but might be the reason some results are different)

LCM version
Use it with 5-15 steps, ~2 cfg. LCM VERSION WORKS ONLY WITH LCM SAMPLER (to get it on Auto1111 you currently need a plugin).

Being a distilled model it has lower quality compared to the base one. However it's MUCH faster and perfect for video and real time applications.

Brief history

Chatting on Discord, I noticed my Mushoku Tensei style LoRA, while trained on AnyLoRA, was performing a bit better on CyberAlchemist's AnimeMix base model. I read on his HF that the model was a supermerge of AnythingElse, his AnimeMix lora and various other style loras. Since AnimeMix was already including many of my old anime style loras, I wanted to experiment and try to make a model that could maximize the result of my Mushoku Tensei style, going beyond what AnyLoRA and AnimeMix could do.

After testing many different versions, adjusting the settings and receiving feedback from the Discord channel, I ended up with a version that works very well on anime loras trained on AnyLoRA (base). Especially my Mushoku Tensei one which felt very weak on AnyLoRA.

I don't advise using this for anime style training (limit to generation after training it on AnyLoRA or NAI), but it might actually be fairly good for character loras where your dataset is made mostly of anime screencaps. It should technically reduce the anime style impact making the character lora less overfitted. I'll definitely experiment with it in the following weeks.