Sign In

Flux to SDXL Style with IP Adapter

23
157
8
Updated: Mar 16, 2025
style
Type
Workflows
Stats
46
Reviews
Published
Mar 16, 2025
Base Model
Flux.1 D
Hash
AutoV2
2FC2E79052
The FLUX.1 [dev] Model is licensed by Black Forest Labs. Inc. under the FLUX.1 [dev] Non-Commercial License. Copyright Black Forest Labs. Inc.
IN NO EVENT SHALL BLACK FOREST LABS, INC. BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH USE OF THIS MODEL.

Version 1.1: Added IP Adapter Noise node which sharpens up style details significantly. I didn't change it in the workflow, but setting a weight_style to 1.8 instead of 1 can apply the style more completely across the image, more than just the foreground. Like all of these settings, the benefit is subjective, so what may work best for one style input may work better without it on another input image.

Version 1.0: This ComfyUI workflow is useful for rendering a Flux image and then applying a style over it with SDXL's IP Adapter and Controlnet ability.

Adjusting the end percent on the Apply Controlnet node from 0.5 to 0.7 can increase how closely the image adheres to the composition of the original flux image. The controlnet model that's used can be downloaded here:

https://huggingface.co/xinsir/controlnet-tile-sdxl-1.0

The IP adapter models and various other nodes that are non-standard can be downloaded inside ComfyUI's model and node manager.

I'm using Flux Dev with a niji anime lora:

https://civitai.com/models/871757?modelVersionId=1042979

The SDXL model I'm using is Jibmix:

https://civitai.com/models/194768?modelVersionId=672019