santa hat
deerdeer nosedeer glow
Sign In

For NAI3 and AnimagineV3, artists' name could be the key to control the style of images.

For NAI3 and AnimagineV3, artists' name could be the key to control the style of images.

Motivation

A few weeks ago, I found some extraordinary images with consistent style on pixiv, the quality was astonishing compared to any image generated by even the best model on civitai, out of curiosity I searched through the pixiv and tried to identify all the users who uploaded those images, then I got a name: NAI3.

So actually NAI3 had been published for months, yet I, and maybe many members of civitai as well, did not pay much attention to it, partly because it was closed source, and partly because 1.5 was still prevailing in community, cause xl cost too much resources but failed to gain community’s favor over 1.5.

But NAI3 was different from previous xl models, I subscribed to NAI for this model, and found that I could not get decent images, as above, directly from its generator, regardless of various structure flaws, the style of those images generated by NAI3 on pixiv were highly consistent, which I deemed as the default style of NAI3 at that time, but the images I generated were just as messy as raw 1.5 and xl images, what’s the problem?

The answer is “artists”, there is an specific technic developed after the release of NAI3: combine multiple artists’ name together in the prompt to achieve various styles, this technic was proven to be extremely versatile cause it could blend different artists’ style by permutation and combination, considering the huge amount of artists on Danbooru, the possibility is infinite.

Maybe this kind of artist series had existed long time ago, but only after NAI3 had trained on the dataset of Danbooru and learned the styles of different artists could these artist series exert immense influence on the style of generated images, ultimately achieved the excellent result as shown above.

The next question, what exactly the artist series is to generate consistent-style images? Before we continue, there is an important question needed to be noted: NAI3 gained its magical style fusion ability from Danbooru, could AnimagineV3 possesses this potential too?

AnimagineV3 mimicked NAI3 in many ways, now it turns out the most important component may be Danbooru’s dataset, I don’t know if NovelAI or CagliostroLab had expected such outcome when they decided to train on Danbooru, but from now on, Danbooru should be crucial to any future model.

I also checked PonyV6, another famous model in community, but in its homepage they wrote that all the artists’ name had been removed during training, that’s a pity, open source community didn’t have many models which could afford high training expenditure, artists’ works without label of name would just vanish into the sea of training data, like a drop of ink in lake.

Artist Series

Back to topic, I’ve gathered some information on artist series, below are some tips for it:

  1. Some popular artists such as tianliang duohe fangdongye, ask_(askzy), wlop, modare, sho_(sho_lwlw), have impasto style, make their styles suitable as the basis of the syncretic style.

  2. The length of artist series could be 5, 7, 10 or even more, but the syncretic style is decent enough out of 7 names or so, more names would just be insignificant.

  3. Considering NAI3 and AnimagineV3’s tag ordering design, it’s better to place artist series at the beginning of prompt to gain stronger style influence.

Then here are some examples of images generated by NAI3 with artist series.

[[[elaina_(majo_no_tabitabi)]]], [artist:ningen_mame],artist:ciloranko,[artist:sho_(sho_lwlw)],[[tianliang duohe fangdongye]],[artist:chen_bin], [artist:ishikei],[artist:ask_(askzy),artist:wlop],year 2023, 1girl, shiny skin, witch hat, standing, smile, looking at viewer, close up

seele_vollerei_(herrscher_of_rebirth) , [artist:ningen_mame],artist:ciloranko,[artist:sho_(sho_lwlw)],[[tianliang duohe fangdongye]],[[artist:rhasta]], year 2023, 1girl, white dress, white thighhighs, full body, kneeling, smile, masterpice, best quality, very aesthetic

Character’s name is at the first place, followed with artist series and all the other tags, is the key to reproduce such style, as you can see the two artist series are similar with each other, cause I haven’t put much time in experimenting different combinations yet, maybe community would find something new once people noticed its potential.

Not much to discuss about the above style for now, put the prompt into NAI3 and set resolution at a high level, such as 1088x1920, then you will get similar results, low resolution would do a relatively inferior work, which makes producing high quality images in NAI3 pretty expensive.

Now come to the previous question: would AnimagineV3 possess the same ability as NAI3? We could only seek the answer in experiments.

Experiment

Let me present a rudimentary conclusion first: artist series works in AnimagineV3, but it achieves a different syncretic style out of the same artist series as NAI3.

First, images generated without artist series, the first from NAI3, the second from AnimagineV3.

 year 2023, 1girl, bishoujo, black hair, long hair, emerald eyes, school uniform, kneehighs, black socks, loafers, medium breasts, bare shoulders, hair ribbon, masterpice, best quality, very aesthetic

newest, 1girl, bishoujo, black hair, long hair, emerald eyes, school uniform, kneehighs, black socks, loafers, medium breasts, bare shoulders, hair ribbon, masterpice, best quality, very aesthetic

Then add a popular artist series to it.

[artist:ningen_mame],artist:ciloranko,[artist:sho_(sho_lwlw)],[[tianliang duohe fangdongye]],[[artist:rhasta]], year 2023, 1girl, bishoujo, black hair, long hair, emerald eyes, school uniform, kneehighs, black socks, loafers, medium breasts, bare shoulders, hair ribbon, masterpice, best quality, very aesthetic

[artist:ningen_mame],artist:ciloranko,[artist:sho_(sho_lwlw)],[[tianliang duohe fangdongye]],[[artist:rhasta]], newest, 1girl, bishoujo, black hair, long hair, emerald eyes, school uniform, kneehighs, black socks, loafers, medium breasts, bare shoulders, hair ribbon, masterpice, best quality, very aesthetic

Another artist series.

 artist:alp, {dino (dinoartforame), ciloranko}, [[[[kuroduki (pieat)]]]], [[ask (askzy)]], maeda_hiroyuki, year 2023, 1girl, bishoujo, black hair, long hair, emerald eyes, school uniform, kneehighs, black socks, loafers, medium breasts, bare shoulders, hair ribbon, masterpice, best quality, very aesthetic

 artist:alp, {dino (dinoartforame), ciloranko}, [[[[kuroduki (pieat)]]]], [[ask (askzy)]], maeda_hiroyuki, newest, 1girl, bishoujo, black hair, long hair, emerald eyes, school uniform, kneehighs, black socks, loafers, medium breasts, bare shoulders, hair ribbon, masterpice, best quality, very aesthetic

Stack numerous artists’ name together.

 artist:ATDAN,[artist:ningen_mame],artist:ask (askzy),[artist:hiten_(hitenkei)],[[artist:sy4]],[[artist:alpha_(alpha91)]],[[artist:houraku]],[[[artist:fuzichoco]]],[[artist:sencha_(senchat)]],[[[artist:rei (sanbonzakura)]]],[[artist:chen_bin]],[artist:wlop],[artist:houkisei], year 2023, 1girl, bishoujo, black hair, long hair, emerald eyes, school uniform, kneehighs, black socks, loafers, medium breasts, bare shoulders, hair ribbon, masterpice, best quality, very aesthetic

artist:ATDAN,[artist:ningen_mame],artist:ask (askzy),[artist:hiten_(hitenkei)],[[artist:sy4]],[[artist:alpha_(alpha91)]],[[artist:houraku]],[[[artist:fuzichoco]]],[[artist:sencha_(senchat)]],[[[artist:rei (sanbonzakura)]]],[[artist:chen_bin]],[artist:wlop],[artist:houkisei], newest, 1girl, bishoujo, black hair, long hair, emerald eyes, school uniform, kneehighs, black socks, loafers, medium breasts, bare shoulders, hair ribbon, masterpice, best quality, very aesthetic

NAI3 changed its style drastically, while AnimagineV3 showed relatively small style shift.

Here I merely presented three control experiments, yet we could still draw several conclusions from them.

  1. AnimagineV3 reacts to artist series as expected.

  2. Artist series exerts more significant influence on NAI3 compared to AnimagineV3, especially when too many artists’ name stacked together.

So above is my brief experiment on NAI3 and AnimagineV3, simple but enough to present an opinion: artist series is essential to control the style of images for now, huge potential hidden in the combination of styles of different artists, this potential deserves our attention.

Collection

Below is my collection of artist series, try them out if you are interested, and don’t forget they are only applicable for models trained on Danbooru’s artists collection or similar dataset.

0. 
[artist:ningen_mame],artist:ciloranko,[artist:sho_(sho_lwlw)],[[tianliang duohe fangdongye]],[[artist:rhasta]],year 2023

[artist:ningen_mame],artist:ciloranko,[artist:sho_(sho_lwlw)],[[tianliang duohe fangdongye]],[artist:chen_bin], [artist:ishikei],[artist:ask_(askzy),artist:wlop],year 2023
1. 
{{artist:tsurusaki takahiro}}, artist:kylin, artist:wagashi (dagashiya), {{{artist:nawakena}}}, artist:chen_bin, [artist:kedama_milk], [[artist:wlop]], [artist:hiten_hitenkei], {{artist:matanonki}}
2. 
artist:ATDAN,[artist:ningen_mame],artist:ask (askzy),[artist:hiten_(hitenkei)],[[artist:sy4]],[[artist:alpha_(alpha91)]],[[artist:houraku]],[[[artist:fuzichoco]]],[[artist:sencha_(senchat)]],[[[artist:rei (sanbonzakura)]]],[[artist:chen_bin]],[artist:wlop],[artist:houkisei],
3. 
artist:alp, {dino (dinoartforame), ciloranko}, [[[[kuroduki (pieat)]]]], [[ask (askzy)]], maeda_hiroyuki,
4. 
tabi_(tabisumika), yuumei,rella,,konya_karasue,
5. 
artist:ciloranko, artist:hoshi \(snacherubi\), artist:tianliang duohe fangdongye, artist:sho \(sho lwlw\), artist:chen bin
6. 
artist:ciloranko, artist:ningen_mame, artist:sho_(sho_lwlw), artist:tianliang_duohe_fangdongye, artist:rhasta,
7. 
artist:ask(askzy), artist:ciloranko, artist:modare, artist:creayus, artist:reoen, artist:kawacy, artist:rella, artist:wanke, 
8. 
artist:kousaki_rui,[[artist:daifuku_mame_(kageroudt33)]],artist:chyoel,[[artist:lpip]],koe_(mixpi),[artist:atdan],artist:kaninn
9.
[artist:ningen_mame], artist:ciloranko, [artist:sho_(sho_lwlw)], [[artist:tianliang_duohe_fangdongye]], [artist:chen_bin], year 2023
10.
[artist:ningenmame],artist:ciloranko,[artist:sho(sho_lwlw)],[[artist:rhasta]],artist:azuuru,
11.
lm7, lam, atdan, mignon, wlop, amazuyu_tatsuki,shiro9jira, ciloranko,ask_(askzy),novelace,{wlop, reoen}
54

Comments