Sign In

Pototype ControlNet models based on MediaPipe

339
1.9k
12
Updated: Oct 5, 2024
character
Verified:
PickleTensor
Type
Controlnet
Stats
1,657
Reviews
Published
Mar 6, 2023
Base Model
SD 1.5
Hash
AutoV2
FB45C3D136

Pototype ControlNet models based on MediaPipe for pose and hands estimation. Higger "e" numer is better estimation but also greater impact on image. You will need external preprocessor available here!

Usage guideline:

1. Download preprocessor and txt file from gumroad
2. Install requirements - run pip install -r requirements.txt command (in folder where you have downloaded file)
3. Prepare folder with images that you want to preprocess
4. Run command python preprocess.py -mh -mp -s C:\path\to\your\folder - mh is for hands detection, mp for pose (you can try with just the pose which works great!)
5. Inside selected folder will appear detection folder (C:\path\to\your\folder\detection)
6. Copy downloaded models (.ckpt files) to ...\stable-diffusion-webui\extensions\sd-webui-controlnet\models
7. Inside Automatic1111 GUI select ControlNet enabled, preprocessor to None, one of the downloaded models and put image from earlier detection
8. Generate!