Type | |
Stats | 11,020 236 |
Reviews | (1,140) |
Published | Jun 15, 2023 |
Base Model | |
Training | Steps: 23,700 |
Trigger Words | 1990s \(style\) 1980s \(style\) |
Hash | AutoV2 4B145EA48F |
A completely new milestone in model training, my initial desire was to make not just a retro model, but a full-fledged retro tool that does not imitate old anime, but fully recreates them, and with this release I am a few more steps closer to this. (USE BOORU TAGS)
The basis of the model will be the addition of artists from the 80s-00s, as well as a huge number of characters
Let's start in order:
the release was a little delayed because I tried to improve the finished lora, improve detail, volume, and I realized that all attempts at the moment are not working and I need to study this topic deeper. But what came out cannot be compared with the first version, which is a model, you ask - how can the lora be better than the model? Easy, firstly, I used all the video memory during training to achieve the best results, according to my calculations, the best lore (or model) needs about 60-70 gigabytes of video memory, my 24 is not enough, but enough for the neural network to finally start remembering characters, and most importantly their style. Including unusual faces, eyes, noses, even non-standard physiques, I still believe that this process can be improved, but at the moment this is the maximum that I could achieve.
Lora weight: 0.7-1 (at weight 1 there are problems with anatomy, because Lora trained for a very long time)
CFG scale - 3-4 (immediate warning! Use cfg scale 3, I still couldn't solve the problem of art fading with a high cfg scale, so just use a lower one. Don't use less, there may be problems with the anatomy)
prompts: retro artstyle, 1girl <lora:NEW ERA_v2.1:0.8>
4th tail (Hentai model) it is very important to use this model, on which I trained my dataset, on other models (except for the original pony) there are problems with recognizing artists, characters and, in principle, their influence on the lora is too high
Use prompts: masterpiece, best quality
Negative prompts: worst quality, low quality, bad hands, fewer digits, extra digits, bad anatomy, english text, engrish text
anime screencap, anime coloring - two strong tokens, works great, makes the image look like screencaps from anime, can be used both together to enhance it, and separately
retro artstyle - main retro token, present in almost all trained images and produces different results from the 80s-90s
1990s \(style\)- a very strong token that significantly changes the style of the model
1980s \(style\)- currently about the same as the previous one (the reason is that the style of the nineties is a lot of the early nineties, and the early nineties are like the eighties)
2000s \(style\)- again it doesn’t work perfectly, but it’s slightly closer to 00s
display of multiple characters:
these are no longer “twins” who are like two peas in a pod, with the same emotions, skin, hairstyles, clothes, etc.
prompt:
score_9, source_anime, 3girls, 1980s \(style\), cleavage, by kawarajima kou, smile, open mouth, one eye closed, serious, closed mouth, official art <lora:NEW_ERAv2.1:1>
You can use standard tokens from pony diffusion if you think that the quality does not suit you:
score_9, source_anime, score_8_up, score_7_up, best quality
I want to say right away that there is now a lot of discussion in the community about the advisability of using artists in neural networks, I’ll say it frankly and without censorship - I don’t give a fuck. I will not hide artists under any three-letter designations so that it is difficult for people to find them in the model (as the creator of pony diffusion does, this is his right, I do not blame him, but I will not do this myself). I will be adding tons of artists, characters, anime titles under their original names.
The following artists are currently implemented (always put "by" at the beginning):
by urushihara satoshi
by danmakuman
by kitazume hiroyuki - need add more
by kawarajima kou
by kotobuki tsukasa
by hirano toshihiro - need add a little more
there are other artists in the dataset, but their influence on the lora is still too weak.
At the moment I have not compiled a list of added characters, there are so many of them that I’m afraid I’m not ready to spend time on this yet, but most likely I will.
if you are interested in the details, in my post NEW_ERAv1.0 everything is described in detail
The following information applies only to older models based on Stable Diffusion 1.5:
A small version comparison (SD 1.5):
comparison of models (SD 1.5):
I made a video on how to achieve the same quality or just repeat my art
Hands finally reached the style of the 90s. There were many difficulties, dozens of versions, but I found a golden mean, from which I will continue to build on future updates.
just use hires fix as much as your video card is capable of, so as not to give an error, with hires fix 2, upscaler Latent (nearest-exact), the picture will be much more detailed. If you want a style close to the original but with more detail, don't use Denoising strength above 0.55, but to avoid artifacts, do not use too low a value, optimally 0.5
For SD 1.5: Use Abyssorangemix3aom3_aom3a3.safetensors model with these negative prompts:
(worst quality, low quality, extra digits:1.4)
Combined with my other LORA
How to use LoRA's in auto1111:
Update webui (use
git pull
like here or redownload it)Copy the file to
stable-diffusion-webui/models/lora
Select your LoRA like in this video
Make sure to change the weight (by default it's
:1
which is usually too high)
*Information taken from Lykon
Please post your work with or without comments, it will help me improve. Thanks!
If you like my work, click on the heart above, I will be pleased :3