Sign In

Flux Two Pass In Context Editing (Inpainting and In Context Lora)

91
1.8k
27
Updated: Nov 22, 2024
tooldesignworkflowproduct photo
Type
Workflows
Stats
136
Reviews
Published
Nov 22, 2024
Base Model
Flux.1 D
Hash
AutoV2
13FB5EF0B2
The FLUX.1 [dev] Model is licensed by Black Forest Labs. Inc. under the FLUX.1 [dev] Non-Commercial License. Copyright Black Forest Labs. Inc.
IN NO EVENT SHALL BLACK FOREST LABS, INC. BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH USE OF THIS MODEL.

v2.3 update: Two pass sampler to increase the consistency

v2.2 update: Fix missing flux guidance issue

v2.1 update: Remove Lora from the workflow

v2.0 update: Add Target Image And Accept Mask Input

PS: Need the latest Comfyui and newly release inpainting flux model

PS2: You might need to adjust seed a few time to get the best result

Download Inpainting Flux Model (Fill) Here:

https://huggingface.co/black-forest-labs/FLUX.1-Fill-dev/tree/main

V2.0 extention:

https://github.com/lrzjason/Comfyui-In-Context-Lora-Utils

## How to install
Download the zip file.
Extract to ..\ComfyUI\custom_nodes.
Restart ComfyUI

For try on lora, you could download from below:

https://civitai.com/models/950111/flux-simple-try-on-in-context-lora

v1.3 update: added new plugin for simplify in context lora workflow

v1.2 update add more description and tips

add Ratio Based on 1024 for high resolution generation

The remove background node need the ckpt from below url

https://github.com/chflame163/ComfyUI_LayerStyle?tab=readme-ov-file#TransparentBackgroundUltra

As newly discoved in context lora usage of Flux.

https://ali-vilab.github.io/In-Context-LoRA-Page/

We could use image as condition to generate similar output.

I introduce this workflow to simply remove the ic-lighting and inpainting models for product background editing.

Please use with this lora:

https://civitai.com/models/933026/flux-product-design-in-context-lora

Modify the Main Description to descript the input image.

Modify the Extra Description to descript the wanted image. You could refer [IMAGE1] in Extra Description.

For example:

Main Description: This is a picture of a gold pendant. The design of the pendant is very unique, shaped like a pair of spread wings with a heart-shaped hollow in the middle. The whole pendant presents a delicate and elegant feeling, suitable for use as a necklace or bracelet ornament.

Extra Description: A beatiful woman wearing [IMAGE1] walking on street

Feel free to dm me if you have any query.

Contact: [email protected]

QQ Group: 866612947