Pony XL: The strength has to be at 1.0 for the eyes to be accurate to the style.
(Or a better option may be to use strength 0.8 - 0.9 and then inpaint the face at strength 1.0 )
Lower the strength for more flexibility.
If you want the style + more accuracy of the characters choose the base SDXL lora version.
Coraline/Other mother have essentially merged unless you specify hair color, eye color, clothes, etc. but even then it just kind of happens anyways.. ¯\_(ツ)_/¯
I only have a couple Pony models to work with and am not super familiar with the prompting since I'm usually on SD 1.5 so forgive me for the lack of insight.
I may try making a better version for Pony when I'm able~ ♡ ～('▽^人)
