The model is based on 29 images, so the flexibility is not as good as I would like it to be
[PDXL only] The jacket on the shoulders can be generated even without tags in a positive prompt. So add the tags “black jacket, jacket on shoulders” to the negative prompt. Also I recommend reducing the lora strength to 0.75-0.8