Sign In

A Brand New Pony CLIP (100k Name Recognition FT)

7
A Brand New Pony CLIP (100k Name Recognition FT)

PONY 100k CLIP-L

This finetune will restore some name trigger functionality to any PONY model and will not touch pony capability for furry, anime etc

This Finetune can be paired with the base PONY-CLIP-G for anime and cartoon models, with no downsides and likely will enhance natural language.

However the ability to pair it with Laion8B-CLIP-G on realistic models restores name trigger functions that had been lost on PONY.

I encourage you to try it out with your favorite realistic model.

  • Models such as cyberrealistic see a great improvement when using Laion + PONY 100k

  • You still see name improvement with base PONY-G and 100k if you want to split the difference on Furry + Name recognition and natural language

  • CLIP was trained on around 10k highly accurate captioned images that allow for public figure name recognition

How To Use

Comfy UI

Use Dual CLIP loader and save checkpoint to merge in with your favorite checkpoint.

Load image for workflow.

Auto1111/Forge

NOTE FORGE USERS SIMPLY SELECTING THE CLIP MODELS IS NOT ENOUGH, FORGE WILL ALWAYS USE THE CHECKPOINTS CLIP

Also saving the UNET then trying to load doesn't work as forge does not know what SDXL UNET by itself is.

DOWNLOAD COMFY

This will NOT WORK at least with my repo of Forge, the statedict for SDXL UNET is not part of the scripts.

CLIP in FP32

Not required but recommend to save the model in mixed precision

  • Comfy UI --fp32-text-enc

  • Forge/Auto1111 --clip-in-fp32

7

Comments