Well, I decided to go for SDXL option.

The result is not for me to decide how bad or good the result is but I found out that this LoRA sweet spot for a good looking results is 0.60.

I tried different amounts from 1.25 down to 0.30 with different results... but the AI keeps learning on it :)

I even got a couple of pictures with Heterochromia (two color eyes) but those were exceptions :(

Hope you like it.