Sign In

Keep character position/size/shape when Inpainting - Better Inpaint with ControlNet (ComfyUI)

18

Keep character position/size/shape when Inpainting - Better Inpaint with ControlNet (ComfyUI)

Here is a method for automatically using ControlNet for Inpaint in ComfyUI.

Normally, when inpainting, the desired person doesn't always get drawn in a reasonable place and much time is spent attempting to coax the prompt into giving us a good result many generations later.

With this workflow example - Mask over one person, multiple people, or just part of a person. The masked portion gets processed to create OpenPose data, then that gets fed into ControlNet to apply onto the replacement person. You can use this with Loras or IPAdapter as well!

To run this workflow: Load into Comfy, Set the Checkpoint, VAE, and Controlnet (openpose). Seed is 'fixed' in the Ksampler, so you may want to adjust those settings as well.

Let me know in the comments what are your thoughts.

18

Comments