PONY 100k CLIP
100k CLIP-G and CLIP-L improve natural language on any PONY model - autistic, realistic, baseV6
Or you can choose to pair it with Laion8B-CLIP-G on realistic models to restore name triggers trained into SDXL like celebrity.
I encourage you to try it out with your favorite realistic model.
Models such as cyberrealistic see a great improvement when using Laion + PONY 100k
You still see name improvement with base PONY-G and 100k if you want to split the difference on Furry + Name recognition and natural language
CLIP models trained on around 10k highly accurate captioned images that allow for public figure name recognition
How To Use
Comfy UI
Use Dual CLIP loader and save checkpoint to merge in with your favorite checkpoint.
Load image for workflow.
Auto1111/Forge
NOTE FORGE USERS SIMPLY SELECTING THE CLIP MODELS IS NOT ENOUGH, FORGE WILL ALWAYS USE THE CHECKPOINTS CLIP
Also saving the UNET then trying to load doesn't work as forge does not know what SDXL UNET by itself is.
DOWNLOAD COMFY
This will NOT WORK at least with my repo of Forge, the statedict for SDXL UNET is not part of the scripts.
CLIP in FP32
Not required but recommend to save the model in mixed precision
Comfy UI --fp32-text-enc
Forge/Auto1111 --clip-in-fp32