santa hat
deerdeer nosedeer glow
Sign In

LORA and TI questions

We seem to have hit the stage where stuff on CivitAI is now LORA/embeddings rather than new checkpoints. And for the sake of everyone's disk space, that's obviously a good thing.

There are a whole lot of things are not all the clearly spelled out as far as usage, so I'm hoping there might be some answers available.

Embeddings:

If a TI embedding comes in with a trigger word of (derpderp123derp), and a filename of derpderp123derp.pt , it is invoked in a prompt by using derpderp123derp in your prompt. That, I get.

If I take that same TI embedding, and I change the filename to (TI420TI.pt) does it now get invoked via derpderp123derp or via TI420TI?

LORA:

Lots of interesting LORAs are coming out. In general, they're pretty simple to deal with. Three questions on these guys:

First of all, is a trigger necessary? If I've got a LORA called BarackObama, and I am using it, I still don't use <lora:BarackObama:1.0> as a subject, right? Isn't it a modifier of a...thing (in this case, a person) that's existing in the prompt and output. Correct? Or do I want to have Barack Obama in my prompt as a subject and then count on the LORA to Obamify him further?

My understanding is that the LORA is called from the prompt to modify the output, but it isn't really part of the prompt. Isn't that the case?

Let's say someone has a LORA called Barack Obama. I use it by putting it in the correct folder and using in the prompt (because in A1111 I could never get them to work via the additional networks extension) of <lora:barack obama:1.0> to use him at strength 1.0. But Barack Obama is likely token that already exists in the model so...is this LORA totally useless? Can I work around it by renaming the file like I (think) I can with a TI embedding?

Is there any way to...I don't know, make notes in A1111 to keep track of a preferred strength and what keywords are needed, apart from just a notepad file somewhere?

2 Answers

If I take that same TI embedding, and I change the filename to (TI420TI.pt) does it now get invoked via derpderp123derp or via TI420TI?

The new name is the token you wanna use, in this case TI420TI

First of all, is a trigger necessary? If I've got a LORA called BarackObama, and I am using it, I still don't use <lora:BarackObama:1.0> as a subject, right? Isn't it a modifier of a...thing (in this case, a person) that's existing in the prompt and output. Correct? Or do I want to have Barack Obama in my prompt as a subject and then count on the LORA to Obamify him further?

Think of LoRAs how you would think of models. Some models need trigger words to operate well and some don't. Usually models trained on subjects need trigger words, so in your case you should probably use "Barack Obama" or whatever the LoRA itself suggests (if the publisher of it suggested trigger words).

My understanding is that the LORA is called from the prompt to modify the output, but it isn't really part of the prompt. Isn't that the case?

It's not really part of the prompt.

Let's say someone has a LORA called Barack Obama. I use it by putting it in the correct folder and using in the prompt (because in A1111 I could never get them to work via the additional networks extension) of <lora:barack obama:1.0> to use him at strength 1.0. But Barack Obama is likely token that already exists in the model so...is this LORA totally useless? Can I work around it by renaming the file like I (think) I can with a TI embedding?

As I said before, it is not really a part of the prompt, so it's not serving as a token. If you were to use the tokens "barack" and "obama", it would just be how it was normally. No need to change the file name.

Is there any way to...I don't know, make notes in A1111 to keep track of a preferred strength and what keywords are needed, apart from just a notepad file somewhere?

Not really take notes, but there are some things you can do to help. One thing you can do is save styles, this you can do by writing the things you want saved in the prompt and/or negative prompt and clicking on the "save style" button below the "generate" (first from the right). Then to apply that "style", select the style you want and click on the "apply selected styles to current prompt" also below the "generate" button (second from the right).

Another thing you can do is install the Image Browser extension and favorite the images you made that you wanna save, then next time you wanna see their parameters you simply go to the favorites tab in the extension.

Sorry for never saying thanks for all this good info.

So, thanks!

Your answer