D4DJ Groovy Mix (style, 20+ characters)

A LoRA (Hadamard Product) based on 1029 Groovy Mix cards, recognizing 20+ characters to varying degrees.

Apparently the franchise is unpopular enough that finding validation prompts becomes a challenge, so most preview prompts come from the training set.

Usage

This Hadamard Product LoRA requires installing an extra extension to be used in the Web UI.

The style itself doesn't have a trigger word. For the characters, below are the character tags and respective top 20 related tags.

Muni Ohnaruto,
yellow eyes, twintails, bow, smile, brown hair, bangs, open mouth, looking at viewer, 1girl, blush, solo, animal ears, dress, frills, multiple girls, long hair, hair bow, ahoge, black hair, long sleeves

Tsubaki Aoyagi,
black hair, long hair, bangs, jewelry, grey eyes, 1girl, open mouth, looking at viewer, solo, breasts, smile, holding, dress, long sleeves, shirt, hair ornament, multiple girls, cleavage, flower, black eyes

Kurumi Shiratori,
long hair, bangs, smile, open mouth, bow, brown eyes, looking at viewer, 1girl, blunt bangs, multiple girls, solo, skirt, hair bow, holding, 2girls, dress, long sleeves, ribbon, blonde hair, blush

Rinku Aimoto,
blonde hair, smile, open mouth, long hair, bangs, red eyes, bow, looking at viewer, braid, holding, 1girl, skirt, solo, multiple girls, jewelry, :d, breasts, shirt, frills, outdoors

Miyu Sakurada,
pink hair, pink eyes, short hair, smile, bangs, open mouth, hair ornament, sparkle, looking at viewer, skirt, 1girl, solo, blush, bow, long sleeves, hairclip, shirt, indoors, holding, :d

Rei Togetsu,
long hair, black hair, bangs, green eyes, smile, open mouth, jewelry, breasts, skirt, bow, 1girl, looking at viewer, sparkle, solo, multiple girls, blunt bangs, bracelet, holding, shirt, frills

Haruna Kasuga,
long hair, bangs, smile, yellow eyes, brown hair, red hair, 1girl, solo, open mouth, looking at viewer, blush, shirt, long sleeves, skirt, frills, dress, breasts, brown eyes, multiple girls, sparkle

Miiko Takeshita,
green eyes, short hair, blonde hair, smile, open mouth, looking at viewer, 1girl, solo, ribbon, skirt, long sleeves, bangs, hair ornament, multiple girls, shirt, ahoge, blush, :d, hat, outdoors

Noa Fukushima,
blonde hair, long hair, bangs, smile, green eyes, skirt, braid, 1girl, solo, open mouth, blunt bangs, looking at viewer, hair bun, long sleeves, holding, blue eyes, multiple girls, outdoors, shirt, dress

Aoi Miyake,
black hair, short hair, smile, brown eyes, 1boy, long sleeves, solo, jewelry, looking at viewer, open mouth, 1girl, shirt, bangs, pants, male focus, yellow eyes, hair between eyes, flower, jacket, white shirt

Kyoko Yamate,
long hair, brown hair, brown eyes, smile, looking at viewer, bangs, 1girl, solo, jacket, open mouth, hat, skirt, breasts, holding, long sleeves, jewelry, baseball cap, multiple girls, hair between eyes, shirt

Shinobu Inuyose,
pink hair, yellow eyes, short hair, smile, 1girl, solo, open mouth, looking at viewer, long sleeves, multiple girls, hood, jacket, brown eyes, shirt, headphones, 2girls, holding, bow, hair ornament, indoors

Saki Izumo,
long hair, bangs, grey eyes, smile, 1girl, open mouth, solo, breasts, looking at viewer, shirt, grey hair, gloves, blunt bangs, blush, skirt, dress, multiple girls, hat, medium breasts, outdoors

Rika Seto,
smile, breasts, open mouth, jewelry, twintails, looking at viewer, brown hair, long hair, bangs, multiple girls, 1girl, yellow eyes, bracelet, flower, hair ornament, cleavage, brown eyes, medium breasts, solo, midriff

Hiiro Yano,
long hair, smile, jewelry, breasts, pink hair, bangs, dress, earrings, 1girl, looking at viewer, grey eyes, parted bangs, solo, indoors, holding, multiple girls, long sleeves, 2girls, cleavage, open mouth

Ibuki Niijima,
long hair, grey hair, smile, blue eyes, bangs, 1girl, solo, ponytail, open mouth, breasts, looking at viewer, shirt, holding, skirt, grey eyes, multiple girls, dress, outdoors, jacket, very long hair

Saori Hidaka,
purple hair, smile, open mouth, bangs, jewelry, 1girl, looking at viewer, breasts, solo, blue eyes, short hair, flower, holding, hair between eyes, hair ornament, shirt, medium breasts, sparkle, bracelet, :d

Maho Akashi,
short hair, blue eyes, smile, black hair, looking at viewer, 1girl, open mouth, solo, bangs, jewelry, breasts, shirt, blush, outdoors, skirt, bracelet, multiple girls, bow, shorts, hair between eyes

Esora Shimizu,
green eyes, green hair, long hair, smile, bangs, twintails, breasts, 1girl, solo, looking at viewer, open mouth, holding, long sleeves, swept bangs, jewelry, sparkle, sidelocks, thighhighs, bow, shirt

Marika Mizushima,
brown hair, purple eyes, long hair, smile, looking at viewer, bangs, breasts, open mouth, 1girl, jewelry, hair ornament, solo, flower, blush, multiple girls, indoors, holding, dress, skirt, sitting

Dalia Matsuyama,
long hair, smile, bangs, jewelry, breasts, looking at viewer, grey hair, 1girl, solo, cleavage, multiple girls, hair ornament, sparkle, necklace, green eyes, earrings, bracelet, open mouth, large breasts, flower

Nagisa Tsukimiyama,
blonde hair, short hair, smile, yellow eyes, open mouth, 1girl, looking at viewer, holding, solo, bangs, shirt, blush, long sleeves, jewelry, shorts, multiple girls, instrument, guitar, brown eyes, :d

Yuka Sasago Jennifer,
blonde hair, smile, blue eyes, long hair, open mouth, breasts, 1girl, solo, ponytail, looking at viewer, jewelry, holding, bangs, :d, outdoors, jacket, medium breasts, shirt, multiple girls, cleavage

Towa Hanamaki,
green eyes, short hair, smile, looking at viewer, blue hair, 1girl, bangs, solo, open mouth, blush, breasts, long sleeves, sparkle, outdoors, green hair, dutch angle, skirt, shirt, multiple girls, bow

Michiru Kaibara,
twintails, long hair, bangs, black hair, smile, skirt, open mouth, looking at viewer, brown hair, hair ornament, hoodie, multiple girls, shirt, long sleeves, shiny, 1girl, solo, hood, plaid, blunt bangs

Airi Amano,
long hair, brown hair, brown eyes, smile, bangs, 1girl, solo, breasts, dress, flower, cleavage, hair ornament, jewelry, looking at viewer, braid, blush, medium breasts, outdoors, hair flower, frills

Mana Kase,
long hair, smile, purple eyes, looking at viewer, brown hair, 1girl, solo, breasts, bangs, one eye closed, dress, white dress, flower, blush, jewelry, earrings, indoors, sitting, dutch angle, bow

Shano Himegami,
black hair, purple eyes, 1girl, long hair, breasts, solo, looking at viewer, smile, jewelry, pants, large breasts, earrings, brown hair, sitting, indoors, sparkle, high heels, bangs, navel, white pants

Toka Takao,
black hair, mole, 1girl, solo, breasts, bangs, skirt, looking at viewer, long sleeves, black eyes, medium breasts, blue eyes, indoors, holding, jewelry, smile, blush, long hair, dutch angle, sparkle

Neo,
1girl, solo, blonde hair, long hair, blue eyes, jewelry, pantyhose, black dress, looking at viewer, crossed arms, necklace, dress, collarbone, breasts, choker, earrings, black pantyhose, cowboy shot, cleavage, generic background

Sophia,
1girl, solo, short hair, black nails, fishnets, purple eyes, looking at viewer, hood, shorts, horns, belt, cowboy shot, hood up, nail polish, hair over one eye, blue hair, ring, own hands together, collar, long sleeves

Elsie,
1girl, solo, claw pose, open mouth, double bun, fishnets, hair bun, yellow eyes, smile, dress, medium hair, looking at viewer, bangs, black dress, ribbon, breasts, white hair, grey hair, black ribbon, bun cover

Weronika,
1girl, solo, smile, armpits, short hair, navel, midriff, torn clothes, grin, jewelry, necklace, looking at viewer, belt, pants, arms up, choker, breasts, pink hair, torn pants, crop top

Training info

Dataset:

• 1029 Cards collected from D4DJ.Info

Tags generated with SmilingWolf/wd-v1-4-convnextv2-tagger-v2 with a threshold of 0.35. No balancing and tag cleaning.

For cards with rarity no more than 2 stars, a custom tag "generic background" is added.

Training cost: ~2.5 T4 hours

Data distribution:

               character  cards
1          Muni Ohnaruto     48
2         Tsubaki Aoyagi     46
3       Kurumi Shiratori     46
4           Rinku Aimoto     45
5          Miyu Sakurada     45
6            Rei Togetsu     43
7          Haruna Kasuga     43
8        Miiko Takeshita     43
9          Noa Fukushima     42
10            Aoi Miyake     42
11          Kyoko Yamate     41
12       Shinobu Inuyose     41
13            Saki Izumo     41
14             Rika Seto     41
15            Hiiro Yano     41
16         Ibuki Niijima     40
17          Saori Hidaka     40
18           Maho Akashi     39
19         Esora Shimizu     39
20      Marika Mizushima     39
21       Dalia Matsuyama     39
22    Nagisa Tsukimiyama     39
23  Yuka Sasago Jennifer     38
24         Towa Hanamaki     37
25       Michiru Kaibara      9
26            Airi Amano      6
27             Mana Kase      4
28        Shano Himegami      4
29            Toka Takao      4
30                   Neo      1
31                Sophia      1
32                 Elsie      1
33              Weronika      1

Training config:

[model_arguments]
v2 = false
v_parameterization = false
pretrained_model_name_or_path = "Animefull-final-pruned.ckpt"

[additional_network_arguments]
no_metadata = false
unet_lr = 0.0005
text_encoder_lr = 0.0005
network_module = "lycoris.kohya"
network_dim = 16
network_alpha = 1
network_args = [ "conv_dim=0", "conv_alpha=16", "algo=loha",]
network_train_unet_only = false
network_train_text_encoder_only = false

[optimizer_arguments]
optimizer_type = "AdamW8bit"
learning_rate = 0.0005
max_grad_norm = 1.0
lr_scheduler = "cosine"
lr_warmup_steps = 100

[training_arguments]
save_precision = "fp16"
save_every_n_epochs = 1
train_batch_size = 4
max_token_length = 225
mem_eff_attn = false
xformers = true
max_train_epochs = 20
max_data_loader_n_workers = 8
persistent_data_loader_workers = true
gradient_checkpointing = false
gradient_accumulation_steps = 1
mixed_precision = "fp16"
clip_skip = 2
lowram = true

[saving_arguments]
save_model_as = "safetensors"