Style Strength Controller

Or overfitting effect reducer. I really don't know how to name.

NOTE: Forget about v0.1. It is alpha version.

Use v1. It's much better and stabler. Supports all tools. All info in this page has been updated for v1.

What can this LoRA do?

This LoRA can reduce the style of your base model. Or amplify it if strength < 0 and you want something crazy.

This lora will not bring any side effects to the style.

I like the style, why would I reduce its strength?

The real purpose of this LoRA is to reduce overfitting effects and bring creativity back, by just reducing the style a little bit.

Overfitting effects?

Because model was trained too hard, and the dataset has bias.

E.g.:

• noticeable bias. E.g.: Always too bright/dark, generating same faces / things / backgrounds.

• too sensitive to some prompt words.

What's the effect of this LoRA?

The effect mainly depends on what your base model looks like. You should test it and feel yourself.

Here is a example on Hassaku XL v2.1fix. Notice that

• This base model has a noticeable bias towards high brightness, (and signs/paintings on wall, shiny reflections...)

• So at strength -0.3, the model completely ignores the prompt word "dark". Because you amplified the style and bias as well.

• At strength 0.25. Model has much less bias on brightness and feels more natural. Notice the table and wall "wooden" textures. Less weird reflection. The style doesn't noticeable change.

• Strength 0.5 is for reference, weaker style and less bias (looking at viewer, signs/paintings on well, etc). More natural.

This LoRA can also stabilize other LoRAs, avoid "burn" effect caused by super overfitted LoRA.

How to use?

• Just apply it as normal LoRA.

• Find the best strength for your model. Start around 0.2. Super overfitted model may needs > 0.5.

• Working strength is around -0.5~1.

• You don't have to set the patch strength for text encoder. This LoRA does not patch it.

• Some styles heavily affect CFG scale. So you may also need to adjust the CFG scales because the style strength changed.

What's the training data? Why it has zero side effect on style?

This LoRA is "calculated/calibrated" directly from SDXL and Illustrious v0.1/NoobAI ep11. No training process.