Sign In

List of things SDXL is bad at generating

List of things SDXL is bad at generating

Having generated a bunch of images, I feel like there are a bunch of items that SDXL just doesn't understand.

A general tip for when you're not getting what you want, try to describe the item in more detail. Could you add additional context, perhaps which type or breed of dog you are trying to generate. They are not all the same after all.

Try searching wikipedia for some information about the subject, and add keywords found in that article.

My idea is to try to crowd-source and create a list of things that it's just bad at drawing.

The purpose of this list is to have a starting point for fine-tuning models. Maybe each of these items should get a LoRA that specializes in it, which handles all styles, which we can then use to universally improve the quality of base models.

SD1.5 version of this list

SDXL version of this list

SD3 version of this list

List of things that SDXL models in general has trouble generating:

  • Hand

  • Foot

  • Nipple

  • Winking eyes

  • Snake

  • Swan

  • Dog

  • Cat

  • Parrot (non-macaw)

  • Dragons (diverse, detailed)

  • Gryphons

  • Cerberus

  • Umbrella

  • Tennis Racquet

  • Scissors

  • Bow and arrow

  • Sword

  • Rusty swords

  • Hammer

  • Anvil

  • Power line

  • Galaxy that isn't The Milky Way

Lisk of things that SDXL generates always looking the same

  • Dragons

  • Hourglasses

  • Snakes

Please contribute to the list with comments below. If you can post to images of a the generated object, that'd help even more!

Please keep your suggestions in singular to make it easier to parse and search for.

7

Comments