This is a great start.
Generated image using SPYBG's Char TK then inpainted custom model face. Works like a charm.

The Lora model requires a <5 CFG setting otherwise details starts blurring. Tested with 25-40 steps on dpm++ SDE, dpm++ 2M and DDIM.

Upscaling with different upscalers needs some tweaking otherwise start losing details

Don't kill me for the Heresy. The Emperor Protects.