so in general i dont like hires, because nearly all use it and it makes all models look like very good... at first impression
usual sets are:
10 steps with a denoise of 0.1 to 0.3
the type of upscaler is not that important (usual R-ESRGAN General 4xV3 or R-ESRGAN 4x+ Anime6B)
if you upscale like this mostly the image are smooth and no fine details (no freckles and small details lost)
if you use 20-40 steps with a denoise 0.3 to 0.6
the anatomy is mostly deformed, so at first you should use different sheduler (not sampler)
in A1111/Webforge go to "settings" search for "hires" and activate:
Hires fix: show hires checkpoint and sampler selection (requires Reload UI)
Hires fix: show hires prompt and negative prompt (requires Reload UI)
as example an image is generate with:
40 steps, CFG 5 -> DPM++ 3M SDE and Exponential
hires with 40 steps, denoise 0.6 -> DPM++ 3M SDE and SGM Uniform
so i have good anatomy and good details
you can also try to copy your prompt in hires-prompt and push a bit what you want and delete some unnecessary ...
also you can use loras same way like in prompts. if you have already loras in prompts and if you leave the hires-prompt empty, it will be used twice. thats often too much so use it in prompt with lower weight eg. 0.6, or use it only in hires or copy the prompt without lora in hires-prompt its all on your choice ... play with it ;)
and yes with denoise 0.3-0.6 the image changed a bit sometimes a bit more . . .
one last hint if you have a good image use Topaz to upscale, its not free but ull find it ;)
so write me if you figure out same oder better options ;)
btw. in ADetailer all the same, you can use seperate prompts, loras or leave it blank and play with the "Inpaint denoising strength", also if you use hires you should change the inpaint width/height to your image. and if you have a lora that match only on checkpoint you can choose seperate one.
(iv attached a good face-detector, rename it to *.pt and paste it in \models\adetailer\) it recognize only the face-area, so hairs dont be cuted)
other articles
face-swap: (8/2024, unfortunately, Reaktor and many extensions do not work in Webforge)
https://civitai.com/articles/5002/face-swap-with-adetailer-and-reactor
inpaint:
https://civitai.com/articles/3990/inpaint-sdxl-for-the-manipulation-of-your-images