LEOSAM's Clothing +/- Adjuster 衣物增/减 LoRA

🖥️Welcome to try out the open-source GPT4V-Image-Captioner, developed by my friend and me. It offers a one-click installation and comes integrated with multiple features including image pre-compression, image tagging, and tag statistics. Recently, we also launched the webui plugin version of this tool, everyone is welcome to use it!

🌍欢迎加入QQ群"兔狲·AIGC梦工北厂"，群号 ：780132897 ；"兔狲·AIGC梦工南厂"，群号 ：835297318（入群答案：兔狲）。Telegram群聊“兔狲的SDXL百老汇”，链接：https://t.me/+KkflmfLTAdwzMzI1

📖这是一个调节所绘制对象衣物多少的功能性LoRA。通过将LoRA权重从-1.0调节至1.0，可以实现绘制对象衣物的逐步减少。

This is a functional LoRA for adjusting the amount of clothing on the drawn objects. By adjusting the LoRA weight from -1.0 to 1.0, a gradual reduction of the clothing on the drawn objects can be achieved.

如何制作与封面示意图类似的gif：

SD 文生图界面下方"脚本"的 "XYZ plot" 里有个“提示词搜索/替换”的选项。可以使用这个功能，以固定间隔从-1 到 1，改变lora模型使用权重。然后SD就可以依次同一提示词下、lora权重渐变的一系列图像。得到这些图像后，可使用ffmpeg工具包或者其他 gif 制作工具，将这些图像制作成 gif 动图。

建议使用controlnet中的openpose功能来固定人物姿态。如果你想进一步固定背景，则需要使用inpaint功能。

How to create a gif similar to the cover gif:

In the "XYZ plot" under the "Script" section of the SD interface, there is an option for "Prompt S/R (Prompt search/replacement)". You can use this feature to change the weighting of the Lora model at fixed intervals from -1 to 1. SD can then generate a series of images with the same Prompt and gradually changing Lora weights. After obtaining these images, you can use the FFmpeg toolkit or other GIF creation tools to create animated GIFs from these images.

It is recommended to use the 'OpenPose' feature in ControlNet to fix the character's pose. If you want to further fix the background, you will need to use the 'Inpaint' feature."

如何制作与“Clothing +/- Adjuster”类似的LoRA：

本模型受青龙大佬在此视频中所介绍的第一种方法“复印学习法”启发。我进行了一些改进以实现多张图情况下的批量训练。具体的步骤如下：

步骤一：挑选N组不同人物的状态A与状态B对比图片，并形成状态A图像训练集与状态B图像训练集。保证相同人物的状态A与状态B两张图片的文件名相同。

步骤二：对状态A训练集添加txt标签，每个图片只打一个可以区分不同人物的特殊词汇标签。比如有10个人物，那就给每个人物从jinitaimei1至jinitaimei10分配各自的标签。然后将状态A训练集的所有标签复制粘贴进状态B图像训练集中。

步骤三：选择与训练集画风相近的底模C，使用状态A图像训练集进行Lora训练直至模型过拟合，输入人物N的对应标签后，只能生成人物N的状态A照片。

步骤四：将训练得到的过拟合LoRA模型以1.0的比例融合进底模C中（更新：经进一步测试，勾选上same to strength效果会更好），然后用状态B图像训练集基于新底模进行Lora训练。该训练过程不一定要训练至严重过拟合，可以选择LoRA过程文件进行AI绘图测试，只要能通过调节权重，实现状态A至状态B的过渡即可。（更新：经进一步测试，甜蜜点大概在每张图片400在800步范围内）

步骤五：如果训练的LoRA所涉及场景较复杂，在高权重下会出现过拟合的情况。有两种改良的建议：一是进行LoRA分层调节，降低LoRA中与A/B状态切换无关的层数的权重；二是压缩LoRA的维度，比如从64压缩至4。

How to make a LoRA similar to "Clothing +/- Adjuster":

This model is inspired by the first method "Copy Learning" introduced by Qinglong in this video. I made some improvements to implement batch training in the case of multiple images. The specific steps are as follows:

Step 1: Select N groups of comparison images of different characters in State A and State B. Put them into the State A image training set and the State B image training set, respectively. Please ensure that the file names of the two images of State A and State B for the same character are the same.

Step 2: Add txt labels to the State A training set, with each image receiving only one unique word label that distinguishes different characters. For example, if there are 10 characters, assign each character a label from jinitaimei1 to jinitaimei10. Then copy and paste all labels from the State A training set into the State B image training set.

Step 3: Choose a base model C with a similar style to the training set. Use the State A image training set for Lora training until the model overfits.

Step 4: Merge the overfitted LoRA model obtained from training into the base model C at a ratio of 1.0 (Update: After further testing, it will be better to choose same to strength). Then, use the State B image training set for Lora training based on the new base model. This training process does not necessarily need to be trained until severe overfitting occurs; you can choose the LoRA process file for AI drawing tests, as long as the transition from State A to State B can be achieved by adjusting the weight. (Update: 400～800 steps for single pic)

Step 5: If the LoRA training involves complex scenes, overfitting may occur at high weights. There are two suggested improvements: one is to perform layer-by-layer adjustment of LoRA, reducing the weights of layers unrelated to the A/B state switch; the other is to compress the dimensions of LoRA, such as from 64 to 4.

除了这个LoRA之外，我的作品还包括：

• FilmGirl/胶片风 Lora模型：如果你想增加你所绘制人物的真实感，这个Lora就是目前最佳的选择。

• MoonFilm CheckPoint模型：可能是整个civitai上皮肤真实感Top5的写实模型。

• Pallas's cat/兔狲 LoRA模型：兔狲是这个世界最有趣的猫科动物，请将你的GPU算力献给可爱的猫猫。

• 拍立得/Polaroid Lora模型：一个实现拍立得照片质感的LoRA，目前还在进一步改进中。

• EVA『新世纪エヴァンゲリオン』LoRA模型：可以生成类EVA风格泛用人型决战兵器的LoRA，适配EVA 00、EVA 01、EVA 02、EVA 08四款机型。

In addition to this LoRA, my works also include:

• FilmGirl Film Style Lora Model: If you want to increase the realism of the characters you draw, this Lora is currently the best choice.

• MoonFilm CheckPoint Model: Possibly one of the top 5 most realistic skin models on Civitai.

• Pallas's Cat LoRA Model: Pallas's cat is the most interesting feline in the world. Please dedicate your GPU power to these adorable cats.

• Polaroid Lora Model: A LoRA that achieves the texture of Polaroid photos, currently undergoing further improvements.

• EVA "Neon Genesis Evangelion" LoRA Model: A LoRA that generates EVA-style general-purpose humanoid combat weapons, compatible with EVA 00, EVA 01, EVA 02, and EVA 08 models.