Sign In

Anzhc's Face Segmentation (Prototype) | YOLOv8 | Adetailer model

178
1.6k
27
Updated: Mar 8, 2024
tooladetaileryolov8
Type
Other
Stats
1,605
Reviews
Published
Feb 7, 2024
Base Model
Other
Hash
AutoV2
D12B761CB4
Winter Sovereign
Anzhc

Small segmentation model aiming to create accurate masks of face for improved inpainting quality with adetailer extension.

Can also be downloaded at HF: https://huggingface.co/Anzhc/Anzhcs_YOLOs

Script im using: https://github.com/Anzhc/Training-script-for-Ultralytics-YOLO


Usage

Put into `automatic1111/models/adetailer`, or any other place that you know will ork with YOLOv8 models.

Use.


What it does?

Instead of just finding face, it tries to create a mask covering face, which narrows down area of inpainting, which leads to better results, due to attention of model not spreading to anything else.

Yolo face mask:

My face mask:

Due to it being very small(in dataset), and experimental in nature, it's not generalized enough, and will have issues, so be advised.

P.S. In case of tolo face, WHOLE box is inpainted, while my model creates mask to inpaint.

In some cases, particularly close-ups and face shots, standard yolo face model will create hard burn

Because area of inpaint is almost whole image. In case of my model it tries to localize area, which doesn't create such burn.

But yes, here you can see that it's not quite adept with close-ups, and chops it quite a bit.

This is really easy to improve, but im busy with work and other stuff to really do that.