Sign In

FLUX :Joy caption AutoPrompt Vision and Text Gen,

12
198
3
Updated: Aug 21, 2024
tool
Type
Workflows
Stats
198
0
Reviews
Published
Aug 15, 2024
Base Model
SD 1.5
Training
Steps: 1
Epochs: 1
Usage Tips
Clip Skip: 1
Hash
AutoV2
87DB6CA3E9

TO:https://github.com/StartHua/Comfyui_CXH_joy_caption


Note: If the Comfyui_image2prompt node is installed, you can check whether the direct transform version is forcibly rolled back!

1. Install dependencies requirements.txt (note: the version of transformers cannot be too low)
Run automatic download model (manual download recommended)
2.
(1).https://huggingface.co/google/siglip-so400m-patch14-384 and put it in clip/siglip-so400m-patch14-384
(2). It is recommended to download https://huggingface.co/unsloth/Meta-Llama-3.1-8B-bnb-4bit (if you have an A100, you can consider downloading meta-llama/Meta-Llama-3.1-8B) and put it in LLM /Meta-Llama-3.1-8B-bnb-4bit
(3). Must be downloaded manually: https://huggingface.co/spaces/fancyfeast/joy-caption-pre-alpha/tree/main/wpkklhc6 and put it under Joy_caption