Sign In

Lion King - Multi Character/Style LoRA

26
136
1k
17
Verified:
SafeTensor
Type
LoRA
Stats
73
790
299
Reviews
Published
Dec 28, 2024
Base Model
SDXL 1.0
Usage Tips
Strength: 0.8
Trigger Words
disney animation
banzai
edhyena
kiara
kovu
mufasa
nala
nuka
pumbaa
rafiki
+9 more
Hash
AutoV2
F5074ADC3A
default creator card background decoration
efhosci's Avatar
efhosci

Here's an "all-in-one" LoRA for characters from the "Lion King" movies (not including Lion Guard show) as well as the style of the movies and similar "Disney Renaissance" movies. I mostly did this as "practice" for some other multi-concept LoRAs I'm planning on doing soon - most of these characters already have standalone LoRAs or work fairly well on finetuned models, so this may not be as useful if you already have those apart from taking up less disk space. Training for this was somewhat complicated, I trained on a mix of models including base 1.5 and some v-pred and non-vpred furry models, with several rounds of merging/reweighting and resuming from previous weights. I can provide more details if you're interested, but will work on "refining" the process for other datasets I plan to train soon.

Currently I only have a 1.5 version of the model, but will try to get versions for other architectures soon.

Characters and optional helper tags which may make generation more consistent, along with any special notes about odd behaviors. All should be flexible for male/female and anthro/feral, and with some luck may be "species flexible" as well if you negative prompt the default species and specify a different one:

  • banzai (hyena, grey fur/body, yellow sclera, spots, black ears)

    • Fur color seems to be more prone to "color bleed" from other elements than the rest of the characters so specify "grey fur" if it's giving problems

  • edhyena (hyena, grey fur/body, yellow sclera, spots, black ears, derp eyes)

    • Renamed to avoid issues with "ed" as a trigger word

  • kiara (lioness, tan fur/body, yellow sclera, red eyes)

  • kovu (lion, brown fur/body, brown hair/mane, yellow sclera, green eyes)

  • mufasa (lion, yellow fur/body, red hair/mane, yellow sclera, red eyes)

  • nala (lioness, yellow/tan fur/body, yellow sclera, blue eyes)

  • nuka (lion, orange/brown fur/body, black hair/mane, yellow sclera, red eyes)

  • pumbaa (boar, brown/red body/fur, black hair, tusks, yellow sclera)

    • Sometimes ends up with the wrong number of nostrils on his nose, this seems to be a persistent problem with pig-like characters

  • rafiki (baboon, grey body/fur, white hair/mane, yellow sclera)

  • sarabi (lioness, tan fur/body, yellow sclera, red eyes)

  • sarafina (lioness, tan fur/body, yellow sclera, green eyes)

    • This character had some problems with developing "spots" during training and turning into a cheetah, while I eventually fixed it it somewhat overbaked the style into her. You may need a lower LoRA strength to create good realistic versions.

  • shenzi (hyena, grey body/fur, black hair, black ears, spots, yellow sclera)

  • simba (lion, yellow body/fur, red hair/mane, yellow sclera, red eyes)

  • taka (lion, orange/brown fur/body, black hair/mane, yellow sclera, green eyes)

    • Used his "canonical" name rather than "Scar" to avoid issues with prompting for actual scars on him or other characters

  • timon (meerkat, tan fur/body, red hair, black ears, white sclera)

    • Occasional problems with the position of his ears

  • vitani (lioness, tan/orange fur/body, yellow sclera, purple eyes)

  • zazu (bird, hornbill, orange beak, blue feathers/body, white countershading, white sclera)

    • Sometimes ends up with a weird "double beak" face looking in two directions, some seeds are just a bit unstable

  • zira (lioness, tan/brown fur/body, yellow sclera, red eyes)

    • Has some problems with generating black markings on her forehead sometimes, and somewhat more style-baked than most of the other characters

For the movie style, use "disney animation". Can help the characters look more movie-accurate, or be used on its own like a standalone style LoRA with other characters and species. Pretty flexible with different species even though the majority of the trained examples are only lions or hyenas. You may see an over-prevalence of characters with yellow sclera unless specified.