Clothturn Helper XL Remix

*Every like, comment, and post will support me to go further!!

can find more project files/details/workflow on my Patreon Chamber | creating Game, Art | Patreon, also further general support there~
Subscriptions can help me update further and create more~

The remix version uses stable diffusion output images to train,
while the normal version uses 3d models rendering images.
Will try the Merged version later.
It is not an updated version of the normal one IMO, so I created a new post here.

I didn't fix the stable diffusion output images and tag them by hand but I think it will help a lot in the future version,
too busy to try now, (emmm... so poor that I have to focus on something to make a living first~)
just a quick placeholder version by auto-tagging picked raw images.
training data RemixTrain.zip,
training setting RemixTrain.zip,
improve it by yourself refer to the information here if you are in a hurry~

!!!Use clothturn helper 1.5 generated images as canny input at around 0.3 weight can improve quality greatly and benefit a lot from SDXL's better understanding of prompts!!! (just like most of the showcase images, you can compare the prompt and results, awesome! I will train these results merging to LoRA to simplify it later~)

Plan, future, coming soon...

- [ ] more data from 3d models rendering test(about 100(will post if any improvement
- [ ] more steps test (around 5000 (will post if any improvement

- [ ] better tags and prompt test (including wildcards(will post if any improvement
- [ ] charturn (also others‘ turntable) ti for sdxl/sd1.5
- [ ] charturn (also others‘ turntable)remix ver for both sd1.5 and sdxl,
based on about 60 picked-generated images to try to make the output prettier(will post if any improvement,
relate to the current version based on 20-50 3d model render images aimed at multi-view correction
- [ ] charturn age/body shape/height/suit outline/face control test(will post if any improvement
- [ ] my LoRA/models will post in public, and my train/generate tool/workflow will post on my Patreon only

Tried XL CKPT/LoRA plan to improve the hand/palm/finger, hair/helmet/mask, and clothing,
for controllable elements/styles, quantity, and consistency, they did have some improvements, you can feel from these samples above,
The main improvement I feel is a better understanding of the prompts, like some kind of clothes and characters, better to control the outputs by prompts details,

but after training and testing, I think SDXL has some shorting at this stage(3/22/2024):

• the main one, there are not enough awesome checkpoints XL and LoRAs XL to make results as good as SD 1.5,
  both for design tools like style offset, and their beauty level as base/beautify models

• The open pose controller XL is not as good as SD 1.5 version,

• Slower and harder to train/generate
  (4-5min for each 1536*1024 upscale to 1920*1024 then turn on ADetailer with 4 faces, actually with hands improvements may generate better but too slow to add more than 10 palms in ADetailer),
  while lighting versions work faster but their results don't look good enough for me now.

I am not familiar with CKPT XL, and it seems too expensive to train now, so let's support other great creators and wait for some better results,
For more tools LoRA XL, I will do some research and try later~

Good news, RTX 4080 Laptop 12Gb VRAM is enough to train XL LoRA after some settings and updating kohya_ss~

!!! If you want similar results,
Please repeat most of the generate/sample settings from the raw pictures examples above,
including ControlNet(OpenPose) and also others' LoRA,
different extra LoRA/TI have their special efforts, add or delete them to test what suits your targets~

Here is one of the LoRAs I trained for my new workflow, AI-powered designs, and textures(camera-based projection) tools.

for SD XL

Clothturn Helper XL - v1.0 | Stable Diffusion LoRA | Civitai

Charturn Helper Merged XL - v1.0 | Stable Diffusion LoRA | Civitai

for SD 1.5:

-Charturn Helper Merged - v4.0 | Stable Diffusion LoRA | Civitai
- Bodyturn Helper - v3.0 | Stable Diffusion LoRA | Civitai
- Faceturn Helper - v2.0 | Stable Diffusion LoRA | Civitai
- Hairturn Helper - v1.0 | Stable Diffusion LoRA | Civitai
- Clothturn Helper - v1.0 | Stable Diffusion LoRA | Civitai
- Mechturn / Armorturn Helper - v1.0 | Stable Diffusion LoRA | Civitai
- Sword Gen - v1.0 | Stable Diffusion LoRA | Civitai

They work best with my character Library on Blender in the future,
including 3d models' mesh shape edit guide, auto texturing/shading, weight painting, and so on...~
Mostly design for asset creation to develop my own game,
which may help other independent developers like me.

Personally Recommend Checkpoint(only one suitable for SDXL now after testing):
AbyssOrange XL Else - v1.0 | Stable Diffusion Checkpoint | Civitai

Also training data here, about 30 percent of them rendered from artwork I created and posted before 3D models by ChamberSu1996 - Sketchfab,
the rest are bought and collected from the internet: TrainDataPack.zip
Every LoRA was trained from a relatively tiny collection including 20~ 50 pictures for this early and test version, but it still helps a lot now.

And training setting for kohya_ss for every LoRA I create, only uses different data, image size, and epoch, the rest are the same(Turn on XL option): ToonHairTurn_v1.json
(recommend trying your own better data and setting, for I am not familiar with training now, just try to make every step/feature workable this time and keep settings as simple/default as possible,
will learn further about reasonable data, tags, and train settings later,
then train better by only using my own artwork render images to ensure it will be open to use, and follow my styles/tastes)

Add dynamic prompt and wildcard from Civital to help get unlimited different results,  using Gemini and Chat GPT to generate prompt wildcards for testing work well too~

if any questions or anything here interests you, Feel free to contact me by leaving a comment or mailing to [email protected]

Also Discord Channel here~
https://discord.gg/SFJFcctfgD

Every like, comment, post, and Patreon Chamber | creating Game, Art | Patreon Subscriptions can help to get the budget to update further, create more, and post them~