Sign In

A Brand New Pony CLIP (100k Name Recognition FT)

10
A Brand New Pony CLIP (100k Name Recognition FT)

PONY 100k CLIP

100k CLIP-G and CLIP-L improve natural language on any PONY model - autistic, realistic, baseV6

Or you can choose to pair it with Laion8B-CLIP-G on realistic models to restore name triggers trained into SDXL like celebrity.

I encourage you to try it out with your favorite realistic model.

  • Models such as cyberrealistic see a great improvement when using Laion + PONY 100k

  • You still see name improvement with base PONY-G and 100k if you want to split the difference on Furry + Name recognition and natural language

  • CLIP models trained on around 10k highly accurate captioned images that allow for public figure name recognition

How To Use

Comfy UI

Use Dual CLIP loader and save checkpoint to merge in with your favorite checkpoint.

Load image for workflow.

Auto1111/Forge

NOTE FORGE USERS SIMPLY SELECTING THE CLIP MODELS IS NOT ENOUGH, FORGE WILL ALWAYS USE THE CHECKPOINTS CLIP

Also saving the UNET then trying to load doesn't work as forge does not know what SDXL UNET by itself is.

DOWNLOAD COMFY

This will NOT WORK at least with my repo of Forge, the statedict for SDXL UNET is not part of the scripts.

CLIP in FP32

Not required but recommend to save the model in mixed precision

  • Comfy UI --fp32-text-enc

  • Forge/Auto1111 --clip-in-fp32

10

Comments