Type | Workflows |
Stats | 1,323 0 |
Reviews | (45) |
Published | Aug 16, 2024 |
Base Model | |
Hash | AutoV2 0203647740 |
The idea was inspired by 2 videos I watched yesterday.
The first was @Grockster's video "Flux EXTREME - Cutting-Edge Techniques for Ultimate Control" - https://youtu.be/aZt5CL3r1lQ?si=5jAB6SDfqOUfR5Vd - Where they showed using Mask to SEGS with SEGS Detailer for Flux Inpaint. I'd already been using SEGS Detailer but with BBOX Ultralytics and I didn't even know that Mask to SEGS node existed.
The second was @driftjohnson's video "Start using Promptable Masks, Segment Anything & Unlock FLUX Inpainting | Foda V10" - https://www.youtube.com/watch?v=dO2o0YbBvmI - Where he used Florence2 and SAM2 for setting the mask for Inpaint.
After watching both I thought can I connect Florence and SAM2 to the Mask to SEGS to do automatic masking with that and created this work flow.
Instructions are on the workflow.
Note: It sometimes throws up an error on the Florence2 Coordinates node "There's nothing in index: 0 File" It means the Florence Model has not been able to detect the prompted area and empty data has been passed to the node. Either change the prompt you're using to set the mask or try a different model. Base seems to be the most reliable and when I've had this switching to base has worked. I've tried a different image with the same model as well when this has got the error and that has worked fine.