PONY 100k CLIP-L
This finetune will restore some name trigger functionality to any PONY model and will not touch pony capability for furry, anime etc
This Finetune can be paired with the base PONY-CLIP-G for anime and cartoon models, with no downsides and likely will enhance natural language.
However the ability to pair it with Laion8B-CLIP-G on realistic models restores name trigger functions that had been lost on PONY.
I encourage you to try it out with your favorite realistic model.
Models such as cyberrealistic see a great improvement when using Laion + PONY 100k
You still see name improvement with base PONY-G and 100k if you want to split the difference on Furry + Name recognition and natural language
CLIP was trained on around 10k highly accurate captioned images that allow for public figure name recognition
How To Use
Comfy UI
Use Dual CLIP loader and save checkpoint to merge in with your favorite checkpoint.
Load image for workflow.
Auto1111/Forge
NOTE FORGE USERS SIMPLY SELECTING THE CLIP MODELS IS NOT ENOUGH, FORGE WILL ALWAYS USE THE CHECKPOINTS CLIP
Also saving the UNET then trying to load doesn't work as forge does not know what SDXL UNET by itself is.
DOWNLOAD COMFY
This will NOT WORK at least with my repo of Forge, the statedict for SDXL UNET is not part of the scripts.
CLIP in FP32
Not required but recommend to save the model in mixed precision
Comfy UI --fp32-text-enc
Forge/Auto1111 --clip-in-fp32