santa hat
deerdeer nosedeer glow
Sign In

Cloth Migration and dressing style transfer

54
605
2
24
Updated: Nov 15, 2024
styletranscloth
Verified:
SafeTensor
Type
LoRA
Stats
605
2
Reviews
Published
Nov 15, 2024
Base Model
Flux.1 D
Trigger Words
[cloth-on]
Hash
AutoV2
6EF64AF9DD
default creator card background decoration
ttplanet's Avatar
ttplanet
The FLUX.1 [dev] Model is licensed by Black Forest Labs. Inc. under the FLUX.1 [dev] Non-Commercial License. Copyright Black Forest Labs. Inc.
IN NO EVENT SHALL BLACK FOREST LABS, INC. BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH USE OF THIS MODEL.

Contact me:

QQ group: 571587838

Bilibili: homepage

Civitai: ttplanet

wechat: tangtuanzhuzhu

This is an experimental project focused on Stable Diffusion (SD) models. In a single generated image, the same object or character consistently maintains a very high level of consistency. I had already attempted to address this issue in the SDXL model.

At that time, I used the ControlNet model with decaying weights to achieve good results. By using reference images, it was possible to generate multiple views of a single character at once while maintaining extremely high consistency. Due to a busy schedule, further exploration of this work was put on hold.

Recently, I came across discussions about ic-lora and noticed that it remains a standard LoRA but leverages the DIT model to achieve better consistency and excellent control over image formatting. Utilizing this format control effect, there is hope to achieve consistency in applications. Inspired by the concept of a latent-guided workflow introduced by the netizen "lrzjason aka xiaozhi," I simplified the entire preprocessing logic, thereby developing a highly effective migration method.

Through this process and methodology, you can achieve surprising migration and generalization effects by guiding the model to focus on the content you need, providing astonishing consistency. Currently, I have developed a matching migration model for clothing, which offers:

  1. Surprisingly Consistent Reference Image Clothing Migration

    ComfyUI_temp_veptx_00011_

    ComfyUI_temp_bgltt_00001_

  2. Cartoon Clothing to Realism or Real Clothing to Cartoon

    7e95939782f43a7272f2ff796f231871

  3. Control Over Clothing Similarity via Weights to Inspire Design Creativity

More To Do

  1. Transfer of Items with Distinct Features

  2. Transfer of Intricate and Complex Patterns

  3. Face Transfer

  4. Additional Ideas from the Community

How to Use

You can download the model from my Hugging Face project in the Migration LoRA folder. Currently, only the Cloth LoRA is available, but I will add more once they are ready.

Requirements

  • ComfyUI to run the model with auto process.

  • Custom Nodes:

    1. TTP Toolset: ComfyUI_TTP_Toolset (Please update to the latest version)

    2. Tag Node: I recommend using my version which provides a custom_modification for extra direction: ComfyUI_JC2

    3. **I also used Alimama flux inpainting model, to get it from here: Alimama_flux_inpainint

Steps

**workflow is over here workflow

**or download here https://civitai.com/models/950776

  1. Install ComfyUI and the required custom nodes listed above.

  2. Download the Cloth LoRA from the Migration LoRA folder on Hugging Face.

  3. Load the model into ComfyUI.

  4. Use the provided workflow example to achieve the desired results.

  5. Notice select the flux version wisely, as we need to load the Alimama inpainting model at same time, more VRAM needed, try nf8 if you feel slow. or use some momey optimization node like FluxExt-MZ

Feel free to experiment and modify the workflow according to your needs!