I have six folders with pictures of my character. In five folders there are pictures of character in certain outfit. Sixth folder contains all the other outfits. There are 500 images in dataset. I have a character tag to entire dataset, as well as a tag for each certain costume. After training, character's face looks good, but artifacts from other outfits appear on the character. How to fix it? If someone see guide for training character with multiple outfits please give me link
That approach is sound. Increase dataset if possible.
Check for common tags across folders. Remove as many clothing-related tags to have each trigger capture that.
From a params pov you can try to slightly reduce LR and increase steps a bit. I would keep same LR for both TE and Unet.