ghost
Sign In

Why this lora can not bring good result? 这个lora为什么寄了?

Jun 28, 2023
musing
Why this lora can not bring good result? 这个lora为什么寄了?

Warning: I'm not native English speaker. There might be impolite, ironic, rude and offensive words in this article.

Quality of Lora

Making lora for a single character's single costume is not that hard as long as you can find enough suitable images as datasets. Well though most people can learn how to cook instant noodles easily, there are still kitchen-destroyers. I do not recommend to give a image too many repeats. Just image that you just one click to enable the lora and do not have to set it 0.6 or even 0.4 to avoid ruining the picture. A slogan of a chain-restaurant in the city I lived in is "If you dare not serve your dishes to your parents, do not serve it to your costumers." If you find your lora hard to use even for yourself, do not publish it.

If this lora often brings some unwanted and even uncontrollable elements in results, it is likely to be "polluted" or have learnt something wrongly. You should check the tags in datasets, or clean these patterns by photoshop.

As we know that a lora is trained on a certain based model. Most anime loras are trained on NAI, though some trainers might forget choosing that option "other" when uploading. Anyway NAI is from SD1.5. Basically, according to a experiment carried out by Qinglong(https://www.bilibili.com/video/BV1hk4y1Y7sc), the recommended based model for anime lora is NAI. And merged models are not recommended.

Use Models Wisely

Models are like cells and SD1.5 is like a stem cell (NAI is like an "anime stem cell"?). Merged models are like…… cells which have mutated and evovled for serveral generations. They are excellent in doing something but inevitably lose the ability to do something too, and some errors/pollutions may have remained in their DNAs. They have their own thoughts. Someone might even think "What an amazing model! I just input 1girl solo and the outputs are fantastic!"——after trying more tags and prompts, he or she might finally find that this model actually does not respond to certain tags.

Someone might have seen wonderful AI coser images. However result of using anime character loras on photorealistic models are not always satisfying. As mentioned before, cells have evovled into different forms, if you are expecting that a kind of "enzyme" can be used by all the cells, you are really lack of scientific spirit.

Do we really need so many tags for quality?

Several months ago we are using NAI. At that time, tags like "masterpiece" lower down the possibility of The Old Ones coming out. But now, after trainning and merging, tags for quality are not necessary and even bring negative effects. Firstly, you do not know what effects they may bring, thus making the the output hard to control. For example, "detailed eyes" is likely to make colors of your characters wrong. Also, putting too many tags in prompt is like active ingredients being diluted by too much "water".

Oh, remember to check your negative prompt too. Actully nowadays a too long negative prompt won't give you a perfect result but even change the model's style greatly. Some old so-called universal negative prompts even have "succubus" and "french braid", isn't that confusing. I guess "succubus" was added when someone was using a kedama_milk style dreambooth model or embedding in order to avoid the unwanted demon wings.

The Two Geniuses

The first one takes one model for treasure, he regards it as a perfect test paper for loras and regards himself as a lora scientist. He likes using anime loras on his dearest photorealistic model and said "Hey this is not a good lora, it do not work well on photorealistic models. Come and thank me for my hard work on lora testing."

The second one is a "good student" who has a big notebook (or grimoire) full of spells. While The "good student" do not care about what these tags, loras and words of spells mean and where do they come from. He just open the grimoire and read, and even read here and there, thinking he is a great wizard who can mix magic spells easily. I even used to see someone used an eye close-up lora together with a clothing lora, then there is only an eye in the picture. Well did he really know what he was doing? Anyway I do not know.

=========================

警告:以下内容可能包含不礼貌不文明不友好不和谐。

单人劳拉非难事,只需素材佳且足。

然而泡面虽易煮,也有奇人摧后厨。

尺寸剧增效微增,一图重复又重复。

过拟劳拉不可取,费心调权多痛苦。

菜肴不敢呈父母,岂敢营业盼客顾。

异物难控又难除,多是污染入歧途。

先可排查补漏标,亦或抠图来清除。

皆知劳拉底模出,影响泛用定基础。

漫画多从官模来,只是作者偶疏忽。

官模亦自一点五,然却更适阿宅图。

训练大模效更佳,融合大模莫此途。

初模若是干细胞,融模便是已分路。

分化细胞虽有长,却丧全能有偏术。

又经数代天演化,难免基因留错误。

或有一女出好图,便道此模艳绝殊。

岂知其内病重重,不随尔咒将图出。

或见赛博有优伶,轻套劳拉盼着服。

岂知术业有专攻,难免会把特征疏。

昔日皆用官模时,咒多溢美惧魔出。

而今迭代又相融,质量杰作非必录。

不知影响效难控,水冲药淡使图误。

反咒过长亦无用,反使画风偏原谱。

老旧冗文迷惑多,怕是私炉欲除污。

生搬硬套荃不察,数代传来屎山土。

此般妄言将尽前,曾将二士奇行睹。

前者一模视若珍,意气扬扬飞跋扈。

劳拉不思便套用,效果不显便评恶。

叹曰真模难一用,可速谢我能勘误!

后者好学国子生,手持秘典学四库,

不求甚解背经文,几页乱读融水乳。

美瞳特写叠衣服,唯余大眼无织物。

天才奇思难为知,世人挠头空糊涂。

34

Comments