Verified: 2 months ago
SafeTensor
The FLUX.1 [dev] Model is licensed by Black Forest Labs. Inc. under the FLUX.1 [dev] Non-Commercial License. Copyright Black Forest Labs. Inc.
IN NO EVENT SHALL BLACK FOREST LABS, INC. BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH USE OF THIS MODEL.
Asahina Mafuyu F.1 Dev LoRA Model
A LoRA Model based on the base model FLUX.1 Dev.
I use two different kinds of images for training: Cards (not transparent) and Cutouts (transparent). So the background will be single-color, not flexible, I think. So you can control your background freely, I think.
The Usage
Well, The LoRA can be triggered by the single word 'asahina mafuyu', However, I still recommend u to add '1girl, solo, asahina mafuyu' first to your prompt. (If u use nunchaku workflows, u even do not need the so-called trigger word) And it's recommend to use tags in the Danbooru Dataset only.
Also, I only tested the case that the weight of the LoRA is 1.25, and I don't really know if lower value can still make the output normal. (You can test it yourself and tell me in the comment area)
In my tests with the help of nunchaku,
I can use the LoRA with the weight of 1. And don't need to add the LoRA file name in the prompt input.
The Introduction of the Character
距离上次发布LoRA时隔又双叒叕接近六兆年了(bushi),刚放假那段时间我忙了一堆的琐事,好在现在正值暑期,终于回到正轨,并决定继续干下去。
一些基本的训练参数
素材以人物卡面为主(Cards+Cutouts),其中Cutouts是透明的但Cards不是透明的(
训练脚本是直接采用sd-scripts的sd3分支,并受到fluxgym写script的启发,自行手搓脚本和数据设置而成。
考虑到本人笔电配置不佳,所以每次训练的效率不高,并且迄今为止找不到办法有效降低avr_loss的办法 (除了拉高steps,但那样更费时间),
怎么用这个LoRA
跟正常使用SD 1.5的LoRA一样,用FLUX.1 Dev的底模,然后使用触发词'asahina mafuyu'触发LoRA(小提示:如果你采用了跟我一样的nunchaku工作流去加载这个LoRA的话,甚至连这个所谓的触发词都不用写,直接开始写该角色的主要特征),权重默认为1即可。当然,为了保证角色的基本特征被触发(我通过删减一些tags来固定基本的人物特征,这是本期训练的策略上的变化),推荐加上"1girl,solo,asahina mafuyu"这些特征词,并且尽可能只使用DeepBooru词库的词语。
面临的挑战
这个LoRA由于只是对这个新角色的训练,因此在肢体等一些细节上仍有很大的不足。遗憾的是,f.1并不像sd 1.5那样可以随意加入embeddings来暂时克服肢体问题。我的评价是,反复抽卡吧(
(当然如果你有很好的解决方案可以在评论区指点一下,本人感激不尽x)