Based on the great work from:
https://civitai.com/models/2027766/bfs-best-face-swap?modelVersionId=2556739
You need to install the Lab Color Transfer node in your custom_nodes folder in comfy (see attached zip in article attachments on the right)
Also experiment with the step count for the LanPaint Ksampler.
I found some photos work better with 4 steps, others with 8 steps.
If the face is tiny you can increase the resolution param (Set Megapixels) to 2 or 3 and combine with more steps (though this can make the face more plastic).
I added some refinements:
use consistency lora for textures
use dramatic lighting lora for textures
use the color match node to help bring it closer to original lighting
changed sampler/scheduler -- i thing euler_ancestral / normal looks a bit better
use the flux2 anime vae - looks a little sharper
Resources:bfs lora: https://huggingface.co/Alissonerdx/BFS-Best-Face-Swap/tree/main
dramatic lighting lora: https://civitai.com/models/2477155/dramatic-dark-lighting-klein-9b
consistency lora: https://huggingface.co/dx8152/Flux2-Klein-9B-Consistency/tree/main